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(54) [«iHO«»] >J7;l'5''fA« v;l/^^5*^7'7-hWm« 
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1^^10-240904 



"^nmmizm-^x . ^^-}'iz'o\.^xmaimL(omm^ 
y^-a yizidtmm^m^^^^ii^tim^x&'sm 

i:-smmz^LXtii:h^^'^^^B. . 

mimmm^wmLti^miSii:mmiWLm.m^izmi, 
■^tu:zmm'^(r>mm^tifcmmzicim-t^m^Wim^. 

mmmsM^mit. mi^nmmm<^^miz-:>\,^x-w! 



^a^-s-tr, iS^i*»'^.4<ov>-m*Hcie«oyr/i^ 

^BiiiE1SSt<^iil^jKy>' 3 :^(^>T'y>^e64>ti:tiil^ 
■rttAHclEtK^OUT^W^^ A • T • T-b 

x:^^tit mmmmiztijii'r^m-^imi:±&-ti> 

iib^isb(^tifcmuzm.'^xmss^2<7)mmx:h^^^^ 

^mm-th <fc o izmmmim^m^jsmmfmirm 
mti>ti»b<mm^stt:^ii>iz{iitiLi>. m^mnj^i^e 

^wmxh^mt. 

SiilE=i-Ht=;S^t^^<0#5iJSf*«fJST)?>it«:fc§. 19 

mx(>tifzm^mBittzm'yx^-iisiimni»^i> 

^Bir^^iz-^^. 

a yizmmx ^tz!ib<7>^Bt:-tts. 1 *» 

^(omm^i^i^ 3 yi:itLx<^Mmxi}^^x:hL. 

MLmm^m^n?:m^xi,^st^:isi^. 
m&.mmt i.zU'yxmu.mm^m^'sm^^ms^2<D 



(3) 



0-240904 



m^m 1 0 1 mm 1 <ommxij^mt. mim^^ 

^$fi/cffi<i6$- > ^!^^$ii/::m2to?1l^^i^V 3 y{,z 
m^X hixf:z9mMm.Xt^it^^h^n.t:^ (^\,z^ts^ 

T TIC J: hmM<r>tzifx^y^¥^ rmSiiii.lfm.^mz 

[00011 
[0002] 

vmkcri&m\ m.iSit=^i:.^n^iz^m-i>:it^m 

^yf<^^J^im^\^fz'{^^^)^V9^^By ^ tfihh. 
Z.<r> r U3U^'>'3 i^j tctJV^TJi. A<OilSrt'xjr;^ 

>trjL-^'T'^§$-ii-, ^)-y<n>mmiJ*h\L^:^ ■ 
roi^'x ^^X'x^' v-y±iz^-rh , :^^v-y± 



[00 031 dcoid^'JT^l'^-f A • v;l^^^x-fT 

(W5?Sr) (CtJitS r p f i n d e r J SrfflV%/^£^X7^ 
AfcilXM ITp<T'f r7d<<7) r:/5.yi^jt .^.^y 

^< (Brush de Sairiba) j i^X-f A*JJ>.6. 
[00041 

[^Bj;{^»Sllti9i:-ri>ill®l «!3fccoUT;P:J'^A • 

mt^nmzm^i>:itimmx-hh. tztx.{£. 

njau^^i^ay} tzHK-^x. Amer>m^iz^iyitXt!k 
Z(om^<7)^iz^i>itX'^i,^itti>ifi. 

XX:b^^ y ]^±X'^yt:mii^'tZ tizX 0 , v^m^it 

•Thifi. w^^fihrnrnztb^^^mtiii. tmifiiih^ 

[00051 -t^iy-h , WkcO O T)l^^ Jx • 

[ 0 O 0 6 1 ^ftvpx.^ c:<^HH<7)@M{i, S>S*itlia 

k.<rm.^^-th'^iii^xmm^w^z^\,zm^h 

i^m'S:mm-t^:itX'$>h, 
[00071 ;i<o^B^<om<ommi. m^^mx-i^mBiz 

I.. 

[00081 z.om^Ji<ri^i:,\.z^<r>^m,t. m^<r>/^^ 
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!Nf§a^lO-24<5904 



10009] 

Lx^ih-Th'^^^^n.t. mmm^mmLfz^^m^ 

[00 10] mmm^mt. 9mn^h<nim^kz%'i 
X. i^i^^1xrz^■nlm^i^^znmt^. 

[00 11] if^rciixl;:^^.-^ ffl^ttiU^SJi. J'hSP 

Lip-:>im^ixfznm.<rmw,znm-thmm^^m 
^Lx^^mmm^i^-th^Wc^^ts. mm.^m^ 

[00 12] ii:^. »it<(i. $4>tc, ^J-gRjb-'oOjg 

[00 13] i^,:. W^fJS^ati. 

[00 14] iL!tC<it:«;lt:. ^JSfJS^SJi, lo 



[ 0 0 1 5 ] ii/v:. »t t < li, $ (otc. Sl^lflgSrA 
:>3-ri>^w4^<ol^<7)ii^d^vj^3:^S:^t. c:ii<^>1^ 

<7)mm^i^'^m yt:it Lxx-n^tti>msmmMmt 

[0016] »*t<«. ^<D^5>JS«r'»<0W 

:*]-ri>yt:y>OA:'3^Si: . 3- KtcS^ L^<o^?iJSf3&i 
ffJST'ijix/cfc^s i<0A:»3#a*»ioA:ft$ix^c®1tm 

?8i:«-W5ijtc*t LTffjiT hixkmmmiiiizm.-ox^ 
^^stci *)^'^^ixfz^-^m^n<rm^^w^<r>m. 

[ 0 O 1 7 ] 4:^ . Z.iiJ,Zi^x.X . ^^tOig^^Jti/v- 3 
2 cO^^A:b^fai: , S1t<t«A:*3%aS: $ 

SiJ^^glii, i^fflj8«f¥^a<o«f*fiS«i:ll2<oiil^A:»3 
#gb&»^<0W^ltf8i: ^1ff8A*^S*»^ A:*3 

jsttffi^gfc {zmi'yx^m^^^jr^nti'ht^2<r>wMx-)i 
^■m>^h(D^n'mitvmL. ifi-ox-n^ixtzmmm 
i.znm-thim.'mi^^-thmntimiL.xmx <omm 

A^)^S<o1^oiSlf?;Kj^5/' 3 ^^^^-aa^WfAtc-a-iii* 

^J<o|il-mtg<o^^Srm 1 <o«^A:'3#S<^1^iOii^ 
3 yO|3I tiH^.if 3 y\zm^Xh^t:is 

ts, 

[0018] t.fz, fiii<r>mmx)}^mt. :L<r>mms 

[ 0 0 1 9 ] Ccom 1 OS^A:'3^S(i:. #^ t=Bt^<7) 

Mmsaa**f JST (:>tifzmwL<r)m 2comm^'^i^ 3 >-Sr 

c:olli<7)a^A:?3#a*»'oA:J3Sit^^2o« 

m^i^i^B ym^mmfizm-^xm^^mzii oas^^n 

t>ixtz^mi^X'^it^ith^m.^'kti. 
[ 0 0 2 0 ] #n - H ic** L^tffl^lg^^iJ SrfiJ^-C . 

z<D^mz'^tti^'^'^is^mmx:h^&<^mk<^ism 
immmiz)H'ri>m^iotmiZ':>\,^x<7>mimi:jam^ 
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[0 0 2 1 1 ^(D^mmtmi&i^tz^^miSi'mi 

^^•t^ ztizx*). i^m^comt iziiittzTjmmm 
m^^$>izi^^-ti>:Lti}^x'^?>, ttz. zc^ymmMi 

<^±^ $ ^jg^-r s z t . ^^iz^comm^ 
•thcit . 7m&±(7)vm.i:^Bizii^^-th z t 

[0 02 21 tf^. -mm^ii.. mz^^miz^i^-^txm^ 

^m^^<of^lzm■ox^<oM^i^t^i>^^Wlis^m^|,z 

m.'^xmKzti.zx*). mM-t^^^mbmacobtifzm. 

[0 0 2 31 z<D%m<r>^2.<rm}^{,z^h'?)V^^T 4 

rmkii^xm^^zn^h^-km'ttz^<nwmi 
^mz-jm>L'^i\^h'm^^'^^h'!s^^-7.}L. mk 

[00 241 «PSI'<.-;^lC. ^^-fTSrfflV^-Cr-h* 
fflV^-CJPX-r-l>. L^w7!?^'-:>T, fOffl^ti, 2b^^7"-fT 

^^'thWizzcnj^'f ^T<rm^^<rr^^X'kWm 



[00251 

at U-Ci03ti:i.tfM I D I df:?-T'?>?.ei^^Sg2 
c:<7)S|^s^S2*»<i>oiS^A:^J<faSrStt, 

If^mth'^Mz-^io^X. «.3-HillTt2:«!oT^iiI 
ffifSSf«l#^2<^)SI|g;Jti'VH :^C«IST. SS^l 

5&^}ii^-t'<^# - Ymi^z^\^x<rm^'kfsih^£ 

[00261. Z.<r> U T/l^^''f A • ■7;Wf-;»<x -f T • T— 

X. immmk<^mm.m^-k^-th7m^m^^£^m 

8 1 . <^77«ll«^B^S 8 io«Offl®tf ^SrStt . 
tf, i<^73«iHfe^§IS8<Ofl||fifc-3V^Tt>«Mcl¥iffl 

[00271 Z.<rm 1 CS^-^U T;t':J'-f A • v;kf-;<x 
Si^XxA 4 <7)^S<OTl::SI«Sl!K«2 Srffl v%T«l^^ 
^ai otc^$tt-l.7Jlfm««, c:<oS^*i<7)i!)^ 

^. ii/c. :i<n^m^m.i^:^'rJ^A\%. mzmm,zWL^^ 
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[00 2 81 [^ifiSOJ^m] i-r. b'x*X?^v6. 

< {id 1 mm-thtmmm^ 2 t 

C 0 0 2 9 3 02 m^7J»i^S<^3!!rao:^# ^rSK 

[0030] i-r. TJUM^m^B^as tcM lt . 

t^hmffMSSifiX-n^tih ( ::^7^>yTS 10 2), 

[00311 ms^x . 7mmM<7)-y^ -^^-v ^^^-(i:?: 

S 1 04) . 

[00321 m,\^x7mmm.^^m.s},i. ^thtitz 
mm^^tii^ c^T-^ys 10 6). 

[00331 i^C^T . 77iJM«^IIS8{i:. b'v'^;<? 
8) . 

[00 341 msii. m2izi5\^xijkLfz7mmmco^ 

[00 351 03l;t5V^T. b'xJr*;^7 6twJ: Oa« 

^iix7mmm^^s.8i,zx:f}^tiy:zxijm^<^ a 
iiMfli^^a8*{-fcv%Taai$ii-g>. cc?)^, 

[00361 IgEV^T. A:^««^i-^*»'9«)ai$fi./c^J^ 
S $r t i: ic, UATcT) J: ^ iz LT77llM«cO^*«tT=5:*> 

AbLX. ClLS0C1S«S*»ii>ttai$*t;tWtRfi-f-S:lE 

^(r^T, fzbumsfm'o (E^^ept-s^-T) 

:IJ|6]tc:WI<*:®tSS coB«l1f«SrSlK U/^H^it^S:^ 



U-CCK. -r^ri?*). fiLSOtitiV^-C, «iSScoi^tHili 
<^lHM£*|6HlllcOifl&li®«S5ilfc LT. eSlCRteH 

s ' ^j£imyf\^m<r>m^mmimAb tT^as2i:$ ^> 

[0037] JjLhc^ck d^RteiS it/flSaSi: 

fcffiifeAJ^^ni. zbX\ 7imm^<r>^^mT-r 

[0 0 381 E3tc^L:^cm'li:> 0 = 43' X'hh(r> 

x\ z<7)x o^j:mmiimmmt:^if>x-^i\-sm^^t\. 
hzbiz^j:^, L*»t. smmtmM^ti^iiLmoizis 
ifhmmmnt:STmh-tb'^. esiic^i^^ixs® 
mmmn. z<Dmmmnst:KmLtzmns' b.t£h. 

^w^^fih^Lbx. it(r>wmms{,zmk-^h. ^<r> 

[0039] -f^:*)*), S3t::5^tf>:««|-C'Ji. liffl«iS 

^wM-fh m^b n%nmzVf^'L-^p o 1 1> o tenuis 

[00401 JjLhOi 0 tcLT. A:^B«0 d *>ttiai$ 

m-<r>?*rt:-nnmm^^^^z^-th Z. b im^b tt: 
h, 

[00411 ( mmm-ifi 3 tfeia±-c-ifc s j^-^) uuk^ 
[00421 J; wmi<^^%^^x^ 

[00431 I14{i. 3tfccoliSrlSffiS:IEH^Jgi:-rs 
H:^?Ba«tciiaL/cJ©^t:^$*iS:^^«SrSt'r 

[ 0 0 4 4 3 04 IwtJ V^T . >!dlR'CH^/^iEHftJ^**|g 

TiiM«0*<Slt§ttl>C:i:Ci *3^$*T.&ii«Sr 1 

A-CtcJ: ORIt$ix&ii:t:i: 0^$<x«.««S:2 

\iz-th. 

[ 0 0 4 5 ] ®4 fcl^-r J: 0 3SII<^73lia«t=teV» 

itiD-rs) -■MimiX:mir>^t\.h^<nim.^wMf^ 
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[0046] vxTizmmri> x o z<7)jmiiXx/~ 

[004 71 05Ji, mttzX*)^^tif::^^^-yer> 
[0 04 81 -r^h-h. HStCSrTiatl, 1S®«0*« 

«.vii:t:\ 2IHlB<^RI^>'^•r^'->'2p*^4Jt$i^&. c: 
<7)SJ*>''«:?-y 2 p**iSBC J: O^^ti?. i 3 
lHl@«0RW>'N*^'->'3p*«^«$il, ^«^RI^>'^•:5'->' 
SptmAizX DKIt$n§C:i:-C'^K^>'N*:?->^4 
P**^fi£$itS. 

[ 0 0 4 9 1 aeti. Rit>''?^-:^5&«. m.<ommt±iz 

[0 0 5 0] Set^tJV^Tti. ClOMOiil^Sr^t t 
-C, 2-:><7)^N-xicJ;0^$ixfc^^^-?-*t.-fix.3q 

[00 5 1] i-rRlt>'N°:?-^3qt--^''^-C#;t?.i:. 
Mam 0 *JMB i.O^^ni. Z. b T'^/N'^'-V 1 

(omM^^i'-y2 cii,mBizx^mai^iti,zbx. r 

[00 5 21 utiizMLx. mmmotfi. mAx-^m^ 
tih:i bX'^^ixtzmi^-^is^-y 1 r*^ mBxmm 

[0053] t:^v:*^'o-C. IjLhcT) J: d ^E.nm&B^eo 

0 S i i: t-STtE-CftS . 

[00541 L*^ L=5r*«^) . Ja±«0 J: d 'Sr^Zfe^T' 

[0 0 5 5] -eCl-C, 111/124 Z<0Xd^j:7J 
mmmi:^'ti>(>zii. ^co^^UXV-frCO^^-^iP- 

[00 56] ■r=3ri5^. ISB^OlC^i^LT. -etiSrHtf 



<r>bt. R:i*v'?:?->'i<oi3a«. wmkob^vx^^ 

hfz»>. wmW^Obm^^hXof.z^^ixi,wmMiz-y 

\^x\i. wm^o<D-}3^mtLxm7rcthn}&b^h, 
hh\.^t. mm^oifi^m:thmmiznLx\t. w.mi 

j^^Vi:±^-thZbi:iX^h, 
[ 0 0 5 7 1 ^V^T . C:<7)2#a<0SSt>'N':J'->'tCOV^ 

l/ltSSSrtT^r^ i t"C3#S<0S:i*/'«:J'-:y«:^Ji£^ 

h, z<ob^. i^bun. K9^j^^-y<7>mMmiiL 

(7i^y-^j:\,\j^-^-yizm.^j:hRWi'!^—yifi^ \:^ft^ 
^m&L<7yy^j:\^^'<-Sf—yt:miffiizm^i>Zb 

^-yt)mtEt^mmzimM:tiXX/msit:^^ij^\^ 

zbb-r&zbX'. m3^m<oRist^'i^-^yt:^'ti> 

[00581 ±<mm<^mt:m&:m^'tz b 

x\ aiB^f*:*«a*^'^<$nstT. ^^•^i!^-y<o± 
fiS.sri^-r. ztiizj: *) . mm«L^^:!^-y<^R^9m^ 
xx/wmx!Mi:^'r(^!^x. 7mm^^^-ybmmr> 
j-^^-y^^'r?>zbi}^mxt>^, 

[0059] mm. ^<7)t5dR3&«4tfcO%^<^)^N-^-V 
^i^-tmitmX'h i> . 4 iB<0M2:*-r -^TT* 

^<r>^^tiiX/-icr)Rm^-<iS'-yi;'^S^h, Lij^L^ 

i}^ti>. jMLt:3m<^7Tmm^-^i!^-y<r>m^bmmz. 
z<7)Xo^j:m'^^^:f-ytmEi-i>m&iz-y\,^xi,. # 
mizmmm o srsss*? itxisK-r & i b xmm^imm 

^^^-y^^'t^zbt'^mx-h^. 

[0 06 01 't^j:i?ii>. m7C0^-^iZty\,^Xii. ®4<0 
^bmmiz. lS®m0SrHtf4jaSr#>5r^l§*6tU 

^j^^-yi^^-th. m-^x. z<DRm^^^-y 
mmx/mmt:'fT^ozbx. 2mB<os!tt^^^-y^ 

io^matiznLxit. msitsit^mmir^^h^^^z 
bbvx. m<m±.<7)^mi:i^-t. 
[0061] mm±wti^KX±.<^x oizLx^m.^tif:zR 
mi^^-^^-yx-mnbrnK^ti^b. ztit^. TrmmWi 
tznm-i>^'<^-yb^i>. 
[0062] Hsji. i:j±mmLtzx o^Tjmmm^ 

mLX7Tmmm^m!Miz'z>\. ^x mmt^ . 
[006 31 Timmm^MiMsaiz^ t'T**;*?^ 

S202) . 
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[00 64] ^v-^T. m^M^-b^^. m.mWkk^j:i>mWL 
204) . 

[ 0 0 6 5 3 iBEv^T. A:fJ^titimw^m^izm':f\>^ 
X . Wm^<r>'^^ L¥'^^j:hixh (J^x -y r S 2 0 
6) . 

1 0 0 6 6 3 IKV^T , <0l^**1f 55:*)^ ( -y 
:7-S2 08) . ^ h\,ZfmMf,Z-o\^XRmLfzimit^j: 

•yrS2 1 0) . 

[00673 m^X . Sia^fls<O^P*«^T 

<7)WS\ifi'^^j:iiiX (X7">y7'S 2 1 2 ) , TJH^^^ 

mthm^m^^mTm^ i o caji^j-r * ( -y r s 

2 14). 

[00683-^, 7T«M«^^«8{i. ^HO^Sf 
i}i%-TLX\^^^^'^tPmtht (Xx-/rS212) , 

>^-r «y 7* s 2 0 8 tcj!aai&s*s-n. . 

[00693 KLhO J: p . affi^f^s*^'^^N*:?- 

yx'W^f^<^tii,t.xmm. (:&j»iH«) <oKte^ 

[00703 JSLhittBBLfc^^ii. iEHft?g?^iyt:J4 

cr>^^m^j:^^j:<mt>^<-r:ittMmX'h->fz. 

xii:Ltiti>izm^^tihzk^< . m<r>jm. tztx.ii 
mAE.nmm i^mf^^tifix-^^. 
[00713 L*»t^:*«^, mmm<7)m^^^ K)-fm 

[00 7 23 09 {i> :i<DXo^^t:^^mX$)^, 

09t=tiv^Tti. mmm.bLx~wtm:E.nmm^i:m 
iz-^\^xmi^ uzmi^-^^-y 1 2: $ i^iz^io^m 

iZ'0\,^XK1iiWm:Lti^-^^-y2i:^Ltzi%^. 
[ 0 0 7 3 3 ^fc. S94't=iJV%T. ;ii^{i^cO^I^Sr 

[00 74 3 01 oli. >m<^ijmtLx. ^izmi>z 

[00753 01 OfcitJV^Tii. ^<'i^^^-yi:i\:n't 
i>l,zhfc'0. iaTO3-P«0J!ES"JSrfflv^TV'v|). 

[00763 ( 1 ) f9i*)}L^j^:^'-yim<Dm^^m 

(2) RS*|iia<0^#=5r#-^<7)yN°:J^-y(i, RItEijK 



[0 077 3 (3) B*Oa*fOyN-^'->'UIJftOji^<0 
le ( 3 ) cOjlftaiCfcV^T. MOii-S^cTJBAOSs^Srjl— ti- 

[00783 Lfztfir>x. x'o^^^-y<o±m.^m^<t 
*>. maiz^LtzmmtKmzx <omM<r>x7-'yy 

x-/rS2 08) tciJV^T. &rFlz^^Xo^2-:><7) 

[0079 3 lllc^3!!iao0yS:01 Itc^-T, 01 icO 
«HlttJV^-C«> !>m(om\tLX. SStSia:<0i!'-'5:V^ 

[00803 -r^r*>t>, iit x.iiziyiiA-ir^'^y^ 

ic. Kmi(>zx 'o^ttz^^^-yizicim'ti>m^t:m&:-( 
y^v^yhL. ^(Tif^-^-^yki^y-y^jyy imm) 
izanhm^^myt^M mT. zntof^) t-rh 

[00813 -r^:*)^. |||i^C{4Zffi<7)/h$ VVN-:?-:^ 

i}^t:>imiizim'thXoiiz>imth<r>x. -txiizmm^ 

itX\.^fzf^'S'—y<7y7.m.ifiZ.iXt^ty^Z. 3 LTV-^f./"? 

[0 082 3 CcoJ:3^r«yi«. iS^^^97^ •y^';^ 
>''^ >y 7 T r;^:^ i; LT>'N— h* X r-fb^ixT V 
[0 0833 tZ-hX^ VJ±j^tzJ^o^£f^^—y<rym. 

viatw-p V \X<7)ii <ryxtb -3 ^v: . 
[0 084 3 Zffl*«5:v^tc^Uv-?;?-i^p±tc«^:0 

[ 0 0 8 5 3 0 . >''«:?->'Sr*SB'r€.J®#lwflffipt 

[00863 01 2{4, C:oJ:3^*!!®Sr^T^3^<OR 
lt^N':?-:^<^>^0«^SrlP52#SO^fe^N-:?->'i-C 



(9) 



[00 87] 01 3(i, ^^-i^-ycT^^^m^^-t 
mmkcr>w.f^-s'-yo<r>^mz'z>\^x. mm\t.i:>*) 

[00 88] aaA$:M^^^ll^^: UT. m^<^-yot:m& 

ltJj:tXCl3&*iiO)iI#T-^fi£$tii.. SglSBc7)#R 

100 891 t/v:*«-3t:, ^2m^(^w.ws^-<9-y<r>^ 

mi. ^f-^^-yA 1 , B 1 , C 1 cryvmx-'^tchtl 

h. i /i,.RM>'^ A ico^-iatc-ov-^tt, ^^n- 

tt/N':?— yA 1 cOjaBt^OWT >'AB 2«0 

:tr*^ WMJ'^^-yAC2i:*) hmtS.ii^^-^, WM^^ 
9-yBiii3;iX^cii.z'o\^X(r>w.2^Wi<r>mM^^9'- 
yiiZ'^\^x{inmrhh, si 3c*jv^"C(±. 

tCfC^^$il-i.®3feieSr ( 1 ) ~ ( 1 0 ) T-ai^LT 

[0090] -H. feimBBLyii dfc:. 
^ 0 t ^^J^ tc±« S: ^T^: o i^T'Ji'S: < , t Z 
m.(r>j^^-y<r>t^\t2-:> (ifcti-eixl'lii) <o>'n*^'- 

[00 9 1] 112 <7):^fcL-C{S. 014tw^LfcJ:d 
c:<o:tr^-C<i. ^o^l^i:LT, 

[00 92] ^tfDio^SrKHlCtSV^T, =8-MOJI^SrilS 
;c -C ( N° rJ' - > Sr ^ L ^ i: V a MiiJ (c J: 0 Ste tJ i 

[0093] imm0fm2 ] 0 1 5 ti. ^^BBonifi 
<ojK® 2<o«^73iN^s<^<s«s-s^-rmro -y 9m 
xthh, 

[00941 mi&<mm 1 <r)m,=Fimmmm.cnm^tm 



Sr±fi£-r 1. 7 -f -y ^fi^S 1 4 ?> C i: , 
immSi^^'S. 1 2 *«t-7':t3!r 7 6 *»^>Stt:^c«« 

tf A-^-^^:? -f y ^x^^Sl 4*»4>ai:'3$<x€.^^ 

[0095] ^<r>i^cr)n-^^z\m~^^HLxm. 

^Sl 2tJJ:lX3:^tjL-^^^97^ •y^'j^^fefi^H 

[00961 mmcomm 1 iziiifi,7Tmm.m^^ms 
(omf^tmmiz. 7mmiSk^mmi2a. f-r^r;^^ 

-f "/i^X^jS^S 1 4{i:jS^^}liB7-a 

[0097] TJ^OI^^M 1 2 3 ytTi-:^ 
i5^57-f y^Xit^ai 4*»|?>ai:»3$*U:3yeA- 

t-c, m3\zii\^xmm^f:i<niimk(m^z^'^x. 
[oo9 8j0i7«. ^<rm!i&.2<n(^=i-immss. 

<0iM^mW-^?.:7o-^A'->'CS>«>. lilT. 017 
[00991 TTH^m^^S 1 2tC. b'T^jf;^^ 5 6 
02) . 

[0100] iBEv»T. jm^'s^^m.x 2\t. wm 

«. (X7"'yrS3 04) . 

[0101] 73^<a^fi^Mi 2{i. x-n"^ 
fx.tmwnjm.f^'y^—^^zm^.x. wsmm}*tz,w^ 

(Ax-yrS306) . 

[0 1021— :rc. 3vtrjL-^i!^57^ •v^'x^ 

igBi4{±, ^\ui)^hH-LhfiSt^—9^zm.->x. nm. 

<0^*4t^ P C^T- y r S 3 0 8 ) . 

[0i03]«Sv^T. ■ciy\£:>.—9y'^y<-/9:^^ 
5iai4{i. ^'^g|5*»^>4^■i.^^>i^^T-:^i::S-:^v^•c. laj 

^«W-Jg«t2;**iELT. 3>'tjL-:J'^^7 7^ y^X 
H«<0«l5-r«.®i«<0»ai («jait) ^4=f^r-5 C^T^-y 
rs3 1 0 ) . 

[01041 immk^E]Si^m.\ 

^Ot^mi 4i}^^iii-^^ttt:^y\^sL-99'^y >( -y^ 



(10) 



1^^10-240904 



i> <;:?.X"/7-S3 1 2) , 

ioio5ii^v%T. jm^m^^m.! 2ii. -^b£$ 

(XT-yrSS 14), 
Srff'Srd (:^7^yrS3 16) . 

c 0 1 0 7 ] Timmm^^m. 1 2(i, Masra 

3 18), ^mij^^TLx^^^m^nm^mi oi>zn 
m-thmmm^^ aj:J]-r & ( r s 3 2 o ) . 

[0 1 081 ^mcmi3<^TLXK^^j:\^tPmL 
tz%^ (Xx-y7-S3 1 8) , 9m\mWk<7)^i:'ii 
^j: o X-f y r S 3 1 4 tcm'if "T S o 

[01091 iSLhcO J: a tT , #C t'x3r;e^^ 5 6 K 

[01 101 ^rfc, 01 7lCS^t^.:Xx-yrS3 1 6tc 
VXT, SI 1 *^{i01 41CJ: OiJiWt^c3!!UlSrff5rd 

[01111 mm^coi^mi^z m 1 an. zcd^ 
nmmzTTi'tmxh^ .mis iZ7r:-ti&mzt5\,^x ti, 

h-h. mi8tzis\.^x. z<Dmmsimi.. u-K^«ffl 

b tT<7D 1 ^0^1®^ LM I D I ( 5 ■ >f 

x^y/Ppt^^rJ'yP- xv'':?;l' • 7 x-;?.) ^Sl 0 
lb. WmmbLX<r>l-^(^'^MiiMlD imSl 02 
b . U XAffli: LT<0 1 1 0 4 

CltO^ji'SrLMI D imSl 0 lc7)^i^$r5JS-r^ 
tiifX0'7-:!'X7—>-Byi03b'S:'^ts. mi8izti 
v^T«. MIDI^10 1*Jj:lXl0 2i:LT{i. — 
0«i:LT^-;K-h'**3^$<x&. dOdf—df-H 10 1 
tJil^l 0 2(^eili3j;lX|ia<7)?1l^3Ki^'£^3 V**'^*^ 

mm^<^mmx:hi>zx'o. iim<7)^-mmmi}^^^tt 

[0112101 i>z7r:-tx o i>z. m^mm.1 o±izim 
mtmi^'thtiisbizmm^ummmiz'^iyitxm 

it. immm I D I ^:$'-A«fflv%<i>ntv^&. Lij^LKc 

ifi^. mn^bLxit. mcoA^^^j:^-n(-}^x'h^tm 
m^-r^- I'X'htitmm^mx'h o > tti^- i^b^a 
^b(r>Mmmi^(ommi:^b-rht:Mz. m^2bL 
T=¥-!j?-H«rfflv^«.. aT<r>mmtzt5\,^xiiWimx'if> 
4. z<o^if-tf'm^^ti>tii>m^izis\^xi>. z.<n^9 



rh. ^-if^-Y-kl^\^tzmmi,zii\^X . 

[ 0 1 1 3 1 M I D I 7y-*rV^ 1 O 4{i, ^fihWe^-t 

$ixrtJO, ill^JiCl<0i^-l}rx^^l04*»'?><OUX 

$>'^:^a.y^'{4. MIDIA:^3MI iSrtfrt-TMID 
(JJIT, ^-if^-Yb'm'i 1 0 l'v#;tii.n, 
i^iM I D I THRUJB?MTH$-:fl- tT=^-^- H 1 
0 1 *»^>^f — d?— K 1 0 2^Z.ff}9>{ S V^^'a y 

[ 0 11 4 1 y— ^'Xt— 3 1 0 3-Mi, 'Sc— 
K101*»4>MIDI OUTSS^MOlSrtfi-LT^- 
;K-K1 0 l*»ii>oy-h (^4*) ffi^8Srii:-r-S.MI 
D Iffilfi 3 ^S#CJ:i.iS^A:'3ffif8) ** 

#£ii>*t, t,tL^-if-—Y 1 0 2*»<?>*4M I D I OU 
T^MO 2 a*»<i>^S^A:tlW^8*^'■^;c '?>tti. . i<0# 
K 1 0 2 *-^>C0?g^A*t»fS{i. LINE O U 
TSS^M O 2 b $r:n- LTjISO:^— X -f :t<i-^OJ^T'r 
V-r/XM—itl 1 0 6-^4-i.<c>*t&. 10 2 

{4. W}lS:mT*5 0, Z(rymmir^'Ji^B>b\.X<r>^ 

^-ri.^fttff8*«r:^r/xi;-;!r i o eci OJiili? 

[0 1151 '7-:5'Xx— i^B^'l 0 3-^4, ^— ;K— 
H 1 0 1 *>^><7)M I D I ^f— h* 1 O 2*»<b<0 
MIDHS«, i3i:tXi^-^>^l 0 4*»<i><0:?>f 

iz^tti^mm^i^x^-i^ii. ::<Ov-y>~9-i04 

[01161 V-^^Xx-v-g y 1 0 3C*gtt$nSSi 

^S^S^^xAti, ^O^f-;i<— K 1 0 1 *>^><75j||^A 

i^^-fUl 0 5^-^;c, -9-'»'b'^:i^*j.-;H 0 5(4, 
i<^'7-:^X-r-v'3>'l 0 3*»feMID I OUTSH 

xryyyxi^-:^ io6^^-x.?>, :L<Ty7vv/x^ 

-;?&10 6-^{4. i^—YV^^riOA. =3f-d<-H102 

[01171 [jSl^^m2^XxA<r)*s;A-7W«J«] 0 
19J4, EllStcSrry— ^'Xt— >'3>'3(clf®$il 

•CS>«>. 01 9tCfcV%T. itfDSI^SaSi^XxAl 2 0 
(4, ftx-:J''f-:J"^-Xl 1 OtCt&tt$*t/2ft-r-^' 

^m«tl, ^<7)m^t^mzvt->xWim^^nti:o . 

[0118] m^—9^—9^—X 1 1 Oi,Zii\^Xit. 



(11) 



iOittx-^'x-rJ'^-Xl 1 OtctS 

[01191 ig^5^i^X-rA 1 2 0J±, iftT-rJ'T'- 
:J"<.-X1 10*»*>-^;t<i>ix|.ft-r-^$r»»fL. #3 

;PO^lS$r^S^'-Ki^'i^ ayt LX<7)^~^^- H 1 0 1 <0 

si^iij^T*»o^-d^-K 1 0 1 i}^(:>(o^^mxtimn^ 
zi^mx (:,ixtz'ammmiz^Lxtii:fj-th'amwm 

^12 4b. mmmi>^i^<r)^ir-fi^iR1i^iiXV^y^ 
^^Ji^-.-K-Hl 0 2iiYLX^l(^ixh^m^cr>'^m 

mmtiz^-ox. ^o-]'iznLxmm-rhzt<7)X'^ 

[01201 ^^fiJSSP 1 2 4 ti. glUT-^ U -Hf 1 2 

2 4 a , Z<r)mV\mmm7—r)V 124a tCtSlftS 

ix^cfieffl^tg=5rif?'J{c^*ixl>^lS$:^-jK->' 10 1 
<r>^i!fi'J'^ a yiZWmX^'^m^^ 1 2 4 b S:-^ 

3 yt LX(7)m^(^'MwmcoMmi!}^—mt vx^^ti 
mizmmth, 

[01211 >( y^v^ y^smi 2 

-MziiiLXim^m^'ryi^ay^tzbtli'r-yf\^ 

mmx'Wikfhy^dr-)v/y-yi^ a yni&'^mfi^ i 

26aS:-^tf. CICO^ >^7^S^3 >S:^1 2 6{i. 

•c. ^m^ifi. 'fyi^ay(r>^-m'k^'rh^i,z\t. 

^(Ti'ryi/ayJ — Vhm^Ltiy.^'ryi^ay^^—Vi: 
W-r«.;^^-;WSraSil?tT, ^^J^SRI 2 4Wftf«fte 
^Wlti'T'-zrjV 1 2 4 a'V^;^ I, . 

[01 221 i^c:o>f:^:}'9^'i^3>-3dS«a5i 2 6 

df-d?-K 1 0 1 ^mmth 'J - H«^3&»<?><ofe 

Stl^fC. jgWife^tSttf— 2 4tc1&W$n/cfiS 

cimc J: 0 . ')-Ymmmcr>tmf.znLz<D^)-Ymm 
^<7)ijmmwL^Kn.^-t^zt-tfiX'^i>, »:tc«-gi5<^ 

[0 1231 [il6T:^y-^f] 02Oti, SI 9(C3^ 

■r siijr-f u -Hf 1 2 2 y jL-;u««Sr«iB&e<>ii^ 
■rs-c<5«.. 02 otfew^T, ei!IT-^'J-^f 1 2 2 



1 2 2 a i: , 3- h'jtfi=»Wa5 12 2 a*»<oCOrJ- Kli 
^fBlctJ!-?-CyU-yUx-r;H 2 2b$r#l!SL. 

Sx^^-;P^g?l 2 2 cSr-^tf. ;W-;l^-:/;n 2 

2 b -fiaji: LT . Z<r>'J^X<r>9Sim^mi.Zi6\th 

\.zm.'>tz)V-)VifiWlii^1xX\^h , n-HJifi^SSl 

msiXhhmmmxhhcnijK ^t'oifcM^^pfi- 

I,. ^^.y-yt-^^gpi 2 2c<4. Z<7)zi-YW^-$M 
mk^hh liZLXlV-tV^-ni' 12 2b L , 3 

[0\2A^tzbUt. 3-h'^jDm7/G7/C 

Zff)^. W&itcmirQih*). Z<7i 
i.o*j:W8Lf.Zii\ih^-VDm7\i. I Im7T'*>'9. 
L/i*>*o -CP - H D m 7 izn LX ffiffl^fg^X^-^t-, 
f ^:;b*>#?iJ{4, D - d o r i a n t 

B biOlStt-r'3-h-Dm73i>«flW9SiXTC^S«^. 
::c7)3-Kdm7{4I I I b 7(7)3— HT'l5S;t«>. i 
<7)3- H P m 7 -Cffiffl^Sg^X^— yWiD - p h r y g 
i anfc^^S^T.^, 

[01251 Ltzt^-oX. Zco:x.y-fl-mM^l 22c 

{t-&ri-HC#*<t*3-Kl — y<7>»Vit^\>'^., tzb 
3-HDm7trfcV^T{4. n-Hl — yliDXF 
/A/CX'h*). —fj. X^—)VT>-d<>r i anOJ© 
■^(C(4. h-^^D/E/F/'G/'A/B/Ct^O. 3 

- H v-yWV<r>v-y%>ists, zixf,zi. o . si^mm 
;n 2 2 b lc#*iii.;P-;Wcfieot:i£ffl™^r&f>J*< 

[0 1 261 112 Hi. S»TrM;-4f 1 2 2c0fl:«t«J 
MWiSmSr^-rat'fci.. ®2 ItCfcV^Ttt, i^>Xco 

x^y-sr-Ymxhh ^mms <rmmBA>^<r>a-Y 

■To 02 llCiSV^TS/hSSOrJ— Cm7/F7/' 
BbM7/E bM7/Am7 b 5/D 7/0017/07 

^)-mmzU'^xmm^^^j::^'ir-)vt^^^tih, m 
(g7) <^)3-KCHi^$*i-s. ^'$-^>'^7 1 

02 1tC*5V%T«. 3-HF7, D7tJj:l^G 
IX'hh. 



(12) 



[ 0 1 2 7 3 3- K F 7 Ji. mm^n- ]^immtif^ 

o 1 i d i an ( Ur^f TV) J s Mydia 

n 7 th (DT-<r>'7jgE) J , Twhole to 
n e ( Hi^)V V—y) J» Tcombinationd 
im. (3yt'*->'3>'-r ^ S^v-aH) J , Tal 
t e r e d (:t;l'^'— K) j , fcilX Thmp 5d ow 
n (>'N-t-.y^^>f-^->'N--7r:J'h5^^^'?:^) j 
X'hh, -Ij. ll6/jN®t5il^^8^jN®it:iittSn-K 
D7fcJ:l^G7lC*tLTJi, -e<7)p1t*<V-frh-T-fc 
0. Tmixo 1 i di anj OX^-;PSrK'.<5^ 

-i 7S<r)3- HC** LTJi 1 oOX^-;Ui0^36«^ 
10128]:: OS21 tcS^-Ti: d IZ. a- h'jt^T$r» 

[0129] i'^m^^(0=f:'J^-)Um^'i 022 

fj^asi 24J4, el!)r-^•J— tf 1 2 2*>^><oJswie* 

«frri.JS^iSmfSfe^gS 1 3 4 a t , 3- Hit^Tt:-^i5-^ 
•C. c:c7)»*Tie*?SilAgei 3 4 a(ci§S^$iT,f>:#3-h' 
izm- hx'r-)Vk fib^tb h ixtzm Xz^-iXWS^-f 
h KWb^(r>xtr—)Vti^\-y<r>^-Y\,zn\JX^^h\:. 
# ) ^^x'r-)vwm> 1 3 4 b i: , 
-mM. 1 3 4 b i 'OWSK'^ixfzm^T.'r-MZ'^t.tx. 
l>^i^S:^-^- K 1 0 1 <r>^mz'^^'^^hixtdm\ 
tCfi!-5-Ci*iEWtS!K5^'i^3 V/=W%nm^U \ 3 4c 
i: . 0 1 8{c^-r^-;K- H 1 0 1 t^t^criW^W^X 

as 1 3 4 c iOMi£J#tttct* o L-C ^^fllffi*^ 
•th=^WIsm^% 1 3 4 d ^-i-tf . )@«fi@m4S«^IBS 1 
3 4 a (4. 0 1 9 \Z.^-tm\^%mm 12 4a 
L, if^Vl^ g V/^lS^ti5#S5 1 3 4 c A«H 1 9 tCS^t" 

mwr^-Ji^ 3 :^/^is«j©wifi5 12 4b i:*ti6-ri. . 

[0 130]fiEfflX^^->'WS!RSP134b(4. E181C 

^■TM I D I '^—Tv^ 10 4 ti^t^(nif A = y^m^iz 

StR-ri.. ::co<$fflx^-;ujStJ?a5l 34b(:fe{ti.. 
1 HtcW L1^<0>?>i^-;l^*5l¥ffif i: S C 1 



-:><r>:!t.ir~fi^^m.m-^m^iz-:>\.^xiimzmmizwm 
[0131] d^i^'i^ 3 yy^^mnmnm 1 3 4 

-;}<-Hl 0 lcO:g-lit*tL#3-l-*iOl^-lg|gSrW^ 

tmizprnx <fc 3 icM^jKi^'s^ 3 

fH^imi 34ctcJ:i.|lItlSggSr*-r«>ffiS*Ptit 

[0 132] c:i-Cs riaigj b\,>ommiz'^\>^x 

mPMtS> , tit - d o r i a n<?>X^r-;UOi® 

dcODkv^dlfJi. ClOX^— ;PO-d o r i an 
izi5\,^xmn (/W-h^) SrWUrv^ 
-S.. UAT. CC7)::^<>-— ;PD-do r i aniCtiV%T> E 
7!^2S. F*«3je. G*<4K. A*«5S. B*J6]K. *5 
J;UC*>'7Jgi:V^3 riSlgj Sr^T-fS. ^k;t{f3^fc 
il^TJKO^ (,IOX:Jr— ;UD- d o r i a nlCfeV^T 

tii. mmx'$>^<r>i)^. ^mx'hh<r>i!}\ tt^i^s.^- 

yh7t hX'h^cOi)^^ i^-f—7t hX'S>i><r)i)>^if<0 
3— HcO^H^SrS^-^. sfirfe, D - i o n i a ncOX^ 
3JK(4F#. 7iKJ±c#k53:&. t/i7&*-5 
®m:v^dk. WD*3il^F<0^|^(4«3^W. 
^Dfcit^Cc7)^|ii(4M7a#S-CJb*OtC«L, 
*5j:r/F#oraHI{4:R3jef[«l:'6:0, ifcWDtJitf 

c^cDmmit^immb^j:^. Ltzij^^xmtsmti 

i<03SiJj:lX7JgO^Sfc:S>«.^'e<^3-b' 
(Dm7T-S)-&<7)**DM7T'2b'l><0*») Sr^^-r^SSSO 

tgj ^a3l^^Si*-C' r 3JS ( I I I) J . r yjgj <o 
2S, 4fiE*5J:t^6S=5:iffc'5-ix 

[0133] ::com2 2 ic^.-Ki^'i^ 3 yy'ttmi'i^s 
4cii^>t.y-Mzt5\^xmtmm^^i>=BMt:^- 

y^pmxt. tit Uim2 3 (A) t:^-ri:d*-. c 

-dor i anfOX^— ;KOi^, •§^^il&#?iJtiC/' 
D/Eb/F/G/A/Bb-CfcS, *3t, -02 3 
( B ) iC^-r i 3tC. F-altere dtfJX^— ;U0 

[0134] 
[»1] 

F/G I. /A b /A ^ /B/D b /E b 

[0135]T'S>^, c:coJ:p^;^^r-;W4. i^^^Xt 

^^■^x.xwiimmmi:m^LtztLxi>. mmmmz 



(13) 



#gl¥l 0-24O9O4 



[01361 ^ZT. iKi^'v- a >'/WlSMl5i't» 134 

0 Itr^OSfJ^Sr^T^a. 
CO 1 371 ia24{i. C:c7)S2 2tC*^.-Ki^'i^3 
ItHJSftlEWS 13 4c tCfc»tS=f-d<- K 1 0 1 <0#fil 

S . 0 2 4 {CS^-r <fc d . ;K 3 >'/^]S*=f;5#a5 3 
4c(i. ^-.i<-Kl 0 lO rKi^s^rV^i^h'j 
-en-e*i*fiSf SSfilKa, Kb. Kc, Kd. Ke. 
Kf , Kg. ■ ■i.znL^1x^ix:L<r>::K^-Mz-^t.ith 

)V-Y^{W^) . 2mr>^. 3JK<0^. 4iKcO^. 5 
SO^. 6S<0W. 7JS<0#. •••SrS'J#tt«>. -r^i?^ 

asitwjk^L. mmizn\:M^^^i>'ktmH\^t:>ix 

V->^^<^^T«7)^A«S'JS-C^>ni.. tzbLM^ 02 4 
tC:t5W%-C.I^KaaC«tT«. eiSKbtC«iJS-C4> 
il^2^<0^<^#^T<0W*s»I^T^fL-i.. dcTJ^v-V 

3 :^/^iS**lSWa5 13 4c ict>v^-c{i. mm^^z^^ 
- K<7)^i^T^c^s!-t> t ^ - l/c i: # tcisii^tc u r 

[0 1381 Z<r>m2A{,Z7fcrXr)^j:^—!r^-Y(r>^}i 

tC*5V^t:t. SI^^*df-d<-H 10 1 CfcV^T r YU 
S^rV^i'b'j hS«Ka~Kg. •"0;?^Srp5{ttf. 

^cr>t%cr>^-Y\znLX . mm^^ti::^'y~Mz^t. 

^X'>--Mzi5ifhmsim^^tix\>^i>tzif>^ 

*) . m^mz&m<r>^^mm Lxmrn^^ z t izx o . 
mizm.mmzm3:iEL\^=^i:mmLxmmi:n^j:o zt 

il^X'tt, 

[01391 :^m<ommiziS\^XX'>--)l^^^<7)tzib 

izm\'^(>tit TA-^'y-siiij izt5\,\xii. rrjif-f 

K>/-M4. X'^-/U(fitpi,z^ttihtzi>i}^ipi?ti>'rm 
mi:X'^^tSm^ffz1}t^i\^ (ii''>^r< t 

^4Si<r>Q.m.i>zmtih. mz^ zi-Yh-ycr)oibi^i,z 
it lei oft<on-^'Ji^f®^^^tll-r^ fcT&i-C'^ 

i05^>X/i,LV%^${t, 9S. 1 IK, 



isil^l 3S<7)7^i^i^3>y-hiO<$ffltci:0#^^fc 
iOlSfigSrWt, lo<ox^r-;prt-cJ4if<0<j)[g*:&S 
2.. 

[0 14 01 Ltzit^-yX. m24iZ^-tJ:oiZ^ #3— 

K 1 0 1 tUtcgiJST S i i: J: 0 . H^O 

i,ZttfiV^. ^^i,zmm^n^oZtil^'C^$>, -TKc 
*)^. #-;Jf— HI 0 1(0 r KWS^ry^v'Kj 

K a~K g ui. ^^,^i,zi3ni> :^y-ji'<o^mim^ 

a. Kc. KetJilfKglC, -eo^^tCtittS^- H 
h-> (IS, 3Je, tJit^TSO^) ijm^x 

t>ti. ^(omco&mizTTii-i Yy-htfzii'ryi^By 

y-hi}<m^Xi^tLh. m4Jg<0#*«giJ^ 
Tii>n&7rOSSKdS:<$ffl-^S!Sfc:t4, **0^<^ 

ilKctJtti: r^-j <7)IIK g ^^^eiii: LTIifiK-r^ 
CitlwiO, a-Yco^i:^-thyU-Xi^{z±^ 

[01411 i^^'X^Z^\,^X^i. 7.*r-)V^<7y^</)^=^ 

f)K ^co^m<o&mco'^(o^'^TtLxm^xx\'^hfz 

[01421 IjLhiO i -5 tc, ZcOTtf'Ji^ a >'/^^Mt5 
WSP 1 3 4 c T, df-5i<- H 1 O 1 (O^liZa L1S| t«S 

^T^roifcKio, mmmuBJumm^tztsifi^yu- 

[0143102 2lC3^-r^lSffi fg^gP 134 dU, 
3 y/^lSMJBftSP 1 3 4 c J: *)nm^'t^1x 

tzmt^^t <^nmmmzmrs\^x , k i o i *» 

1 Q it>h<r>K)}^ixtzm-m^i^<r>t^<7)^-\i<r>. 
niss<^iz^hx=^wm^^m-h. tztt^s, ^ 

-;K->' 1 *>^>0^lS4f?g*^aS|K acomf^$r^-r%& 
#l^«$afefi&a51 34d{4. -5-<Oi:#tfOXl>'-;l' 

1 3 4 d-b-{o<^'mfmMm 1 8ic5^-9-'^^y 

[0 144 1 JSriJ. c:<7)^l«SiJSSPtctJV>-C, n-b'O 

^y^^ifu y ^izm^X^^hfi&t LXm^MLX^^ 



(14) 



0-24O9O4 



[0 14 5] [ittT-^U— fe:<7)^^] ^2 5(i. T 
■^U— k'l 2 2<7)^0y<offifi£S:S^i-|l-C'^>i.. 02 5 
{ciJV^T, r-^U— «f 1 2 2tC-t-tix«»3-HatlT»»f 
aSl 2 2a0^a50:m^;!)JS^$ixS. 02 5ttJWt, 
3-K3t^T8WgCl 2 2a{i. 3-Kffl$B^^{t. i<0 

13 2 a3&^A><7)^'fb*^:^# v^d k ^^-tmrnzm-oxa 

- h'ffil8Sr#SlT-^ t tX 3- h'7^-r;U 1 3 2 c 

ffifgT'7C(7)3-Kffi|gSrg#}^;e.-l.3-K3Sma51 3 2 
bSr-t-tf. C:<?)3-H3!5^gBl 3 2btCj:035^$il^ 
3-Kfif?8Cfi!-^Ta2 6l*S^3~h-Jt?TMWai51 2 
2 afct3V^TB^^^?iJW'5:3- b'ffifBOlft^*«M:WSixT 

[0 1 4 63 024tC^-r«katC, df_;K-Kl 0 1<7) 
^mizftLXii. :^y-Mzt5lfi,Z<7)^ibm.if>i^tvfi. 

m.m^^-th'^if^^ti^'timmxi^ix^, ^.c^m^. x 

i.. Jti:;Uf. 3-h'**Dm7-*G7-»CM7i:^-(b-r 
024t=SrrH<OiSKaS:ifLTV^S«^. H 

l^cai:*i:^it-?>^{i. D^G^Ct^Mbi--^. CLO^O 

<^J:^t^^zz(7imm^m<mti^n^. 

[0 14 7] a-H^-fb^imgCl 3 2a{4. ClOJcd^: 
^^OfRtX**^ 1 2. i; # iCti . 3- H7"-r;H 3 2 c 

Sr#BS Lx . mmmi^A^^ < -r ^ 3 - h tc3:^-t -6 . 

COl I m7-V7^I M7^:V^■53-^'jt^T{S, i^'A-X 

icii V ^ < ai3S-r S CO 3 - H V 7 ok 

mx'±t<^m<7)mi/i}'±th. -e^-c. ;oESb«iaj 

asi 3 2a-C^lt<05Rt^3&«^l:.«.ii:$:«iait. 3-h' 
^SJftlB 1 3 2 b iCfcV^T . 0 2 4 tc^-r HOlglK a IZ^ 

;U?:-r/i>L-Ci"J^TS. 3-HV7i:3-HI I b7 
3--KOfe$-ai-r3S*iJ:i;f7jK<0^<7)»-&ii:*«|3| 



I,. ::<^id^r35«l^tg^3-H{i3-h'7"-r;H 3 
2ctC7^-:/;w<0Jg-c<SW$tLS. -t^:*)*). Cp<i^> 
->?.^-;U:tiV^"C3-l<JtttTiii<I Im7— I I b7— 
IM7^C3-^'*^a#^^;c'c>i^?.. c:<7)igm, m24iz 
S^-TKcOilKacOitli, I I — I I b — I (D— Db — 
C) b^^^i^m'-thtiifXh*). :k^^j:'^M<7)mx/ 

[0148] zcoa- ]^^tm^htifzmzzi- h'ji 
'i=icommi:'if^^t>zbizxo. ^^-vizntxmm 

^z^Eb\^:^ ^-Jl'i:mm-h Z b ffiX'^ h . 
[0149)02 6(4, 02 5tC5rr3-K^-fb«ia3gP 

13 2 atj J;lX3- 3 2 bOlW^SrS^-r^n 

-HT'S)^. WT, C:<7)02 5fcckt/02 6Sr#!lfC 

[0 150] *-r, 3-K3S!-ft5B!ajai51 3 2a'^44, *t 
«3-h'{::g§«-rS3-KMfS**fct(c4-i.'^>ii, 

3- H i: i^S3- b*<o;i^ Kf^^<7)lE^stoa!l^*^^T^:4?^t 

I, (Xx-yTSSO 1 ) . I^WtcM03— Hfc«|fe3 

-Hi: oaH^SElSli: CI C0jktm3- H i; ^^fi<)(cm<7)3- 

i^ix^ (XT-yrS5 02) . C:ir<i>02ocoaB^fflgfil 

[0151] l^Sfi*>tCHuai-r«.3-Ki:*t|fe3- 

^«gtt*^'fcl.. -eci-C. C:ii<o<0 2o<7)j|!l^i^<7)t«#8 
ifib i>iz^ib^i^htit^L^\>m^ 0 v^*»S*h^ 
fJ^*«^f^r*>iiS (X-r«yTS5 04) . iJ'^'5:<i:t— 

3-K*iSJJ?$ixS. 

[ 0 1 5 2 ] Xt" «yrS 5 0 4 tCiSV^T , 2OC0Si^ 

K-f-:/;i'*»'=>. ::<7)^tiK3-Hfcii^^ti&3-H<7)^ 
^b:&|6lS:S^-r^a=^S:#Mx-:? i: 3- H T^-yyWS: 
(x-r*yrS5 0 5) . i<^flF^4. i^HWC 
f*<03- H{=i£-:J< J: d^^>fb^|6lS:^-t^-^*«S«?$ 
ixl>. C:<7)3-H-r-r;ue!^i;J:0, Wm.coim^- 
H*^^SixS. CICIT', 3-h-7^-7';H 3 2cCfc 
*J^3-HfcJ:t^iR=^lC**L, «RcO<^3- 

gf3-h'*ifc'oJ: o^3-H-C2bi.*^43- Hji^T4m 
twi3V^T^=5:«.7ti6. -f^-XiZiitm-^tcMZitzi- K 
•7^-:/;P 13 2c c^a«*«:*c# < ^j:ht:.»>X-hi>. 
[0153] <!K\.^X\ 1^^iXtt^W<r>mM^-¥i}^<^ 

mm>^- Y\izm.m.A'Wm:^-x.h^-Y ^mnsrrh 

(XTr.yrS5 06) . iOXTr«/rS5 0 6tC*JV^-C 
«.-7C<^3~h'J: 0 tfRi^O/jN$5:3-HSrf^3-K 



( 15) 



0-240904 



Mo^SI::^riG**PI t t-J> 0 . ij^^wmfi 1 1 t § v ^ffi 
CO 1 541 <x^^x\ msi^ixtzn^-a-Y^fzitm!, 

^tltZ^mo-Yifi^-Y'mitLX^IfJ^iXh (Xt^ 

^yrsso?). c<7);^f--/rs5 0 7(;i3v^Tai:^$ 
n/in- HWfgti. <ji:v^-c3- ^'^l^7fil$fa5T'3- h'(^ 

[01551 <Ji:v%"t\ -f-KT Yizn^h^mifi^^ 

v^si©-^C{4?lrAXT-y:7-s 5 0 1-^s (xf^-yrs 

508). 

[01561 ±^<DX O n^^- HcOB#^e^tCB>f^ 

ajv^T, Mlll=i-Htc«LTS/MS«t^-^i-*»o|^ 
im^- Y b Lx mta-r^ ZtlzX*). ^^c^mi^O^: 

[0 1 571 =3:*Ji<^3-H3fi3ft«, SI6r:?-U— fcfl 

2 2 (CfcV ^T^T^ijfL-rtC. =^-mm^U l 2 4 tCt5 V>T 

gpi 2 4(C±3>'^'r, #3-H?iJt:*tL, ic0ia2 6lCS^ 
{1^»$-»i-T''f-^- h' 1 0 1 £7)#itlr hf^tO^^ 

[01581 [-^ >^'^^'i^g:^^SSB0^^3 ^2 7 
5 ^' 3 12 6 <^ffiB£Sr«lli&Wt=^ 

1 2 6(4, ff ^^g^#*»'^><7)df-.i<- H 1 0 2 S::n- LT 

hfi.h'^-m'^m.^^vf. mm^- Ymu 1 4 1 

h'rvi^B WmiS^ 1 4 0 1 , 3 >¥<JS'Jg8 1 

4 Otc i OWJ^iiitx^i^ 3 htc^oT-r ^-i^ 

3 ^-/J^t^-yu-T^-yyH 4 3Sr#!SU. ^SM^tg'S:^ 



J:, X^r-;pi|sijgpi 4 2T'il^iJ$fl/wfi6ffl-5rfg^xy 
-^WtlfilCtMo-C , <^ffl^«gX^r-;Wfg*rtgp 1 4 5 (C*S 

i.SX^-;WltRa5 1 4 4 S:-^tf . ::<7)ia2 7 tc:fcv-> 
e!5lSyo«y^'-C^-ni^^^l44ioJ:Vl4 5 

ms-tM.^^tixmii^tih, 
[0159] =ry%^^ i/mm\ 4 ow. 
h'te^gpi 4 l^c^Sitt$il3^c^i^=J-^'1tfSt=^^!or;^ 
-^^^ilS'JL, ^<r>iv-v=^-kW!$'i:.\^x^mwmk 

[01601 ^Vl^ 3 V/T.^r—JVT—f)^ 1 4 3tC 

(4, ia2 8ic5^-ri-5^Xi>--;Ui:«-x^-;Kc*JLT 

112 8tC±5V^X , Of^-ry- b3&^'*tf£kOXy-/UCt5 

t;t3>,'>T<$ffl$ti&xyi^3y{4. #9th (9JK) , 
9th, #9th.#llth, bl3th. fcit/l 
3t h<06®S<b^. 

[01611 X^-~;W^iJ«15 1 4 2t4, ^<^f->i^ a 
^lyJSiJgUl 4 ptci OfJS'J^tt/^r-r:^^^ 3 >'y- h <Stg 

yl-r-:/;^ 14 3 ^«Sfgt . ^$fflnrfg'3:X^-;W^i8giI 
■rs. /v:i:;t{4, ^^1^3 ^'WJSBl 4 Oicfev^T. -r 
:^i^3>y-hb9t hiJit^b 1 3th2r#^*iffl 
V^T V%i>i;¥iJSiJ$tLfc«^tw(4. 14 2 

t4, i<7)M#<0'f->'v' 3 b 2rfilffl"5rt6=5:-r a 
vy— bi; LT-i-tfX^r— ;Pa 1 t e r e d (sT^UrJ'— 
Y) fcil/hmpSd own (^n— ^:::.>y :^ • V^-^— 
•>'N'-7x^b • 5JK - rJ^n^y) SrSJ?-ri., 20<^X 

(4, i<Od*>lo<7)xy-;W*^«5$ix& (ii^^P-^P 
i:ov^T{4mtcgiBJ-r.S.) . 

[01621 7.*r~}VWS<U\ 4 4J4, C:<^X/>-~;Pil 

glJIS 1 4 2*»<?>-^i.4>*l/S«fflnrtgX^r-;Ht$8fclfi!r> 
T , i^ffl "Tfigx :>--;H®Wa5 14 5 *»ii>«fflx y-;PSr 
StRL, ^^fJlgiS^-^X.?*. i<0X:Jr-;US«g|51 4 
4 *»<i>^«S'J^gP^^;c. 4>ix&SfflXi)r-/HS$gK:{4, 

[01631 i^>Xc7)?1l^(Ct3V^-Ct4. 3 - KtCfe 
V^T i:*<5D-r >'i^ 3 >'y- b SrMffl-r-5>*^4}Sl^lC{Jiir 

ff^nxi^o, fNsce*je)WS5v\ Ltztf^^x. mi. 

«>i>. yitX.^, «^#<01A**9thO'r:x5^3>'y 



(16) 
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[0164] ::«ox^-;Wl!J?»^^{i#vl^B#^lctjV^ 
10 165] i^mi 02 9{i. dcO^tSft^f&^W 

jhis<^^«fy<ofiiB£Sr5^-^t:-s>& .029 fza^^x , 

fst^m-rs^s/^s^'i^ 3 >-^j^gi5 1 5 0 h . =¥-d< 
- H 1 0 1 t^h^-z-hixh^mr^i^i^ a ymmt'^ny' 

^'Ji^ 3 ymm 1 5 0*»<5>#x. i^>ii^mm4ii^iy 3 >- 
-§.^«5^J^^ 1 5 2 1 . ^ff55¥<J^a5 1 5 2 i -1.^ 

«i;§^aj{wfe^tT^$ix. ^s/'-K>-'i^3>^^^a5 

15 0 i)^ti>(OmmTi(i^'^ 3 >'«f8Sr#Bg^-:J' i: LT-r 
^-xs y/X^-^WT— T";!/ 1 4 3 5r#BgbT, 

mxy~)ut:m^\^^mm^m^'>--)i'mm 1 s 4 

iO^ffl^SfeX^-- ^UiJSiJgPl 5 4*»4>0^^flg 
X^r-/H»fgttJ!oT. fiM^«lX^r-;PtS}rtfKl 4 5 

1 5 6 Sr-^tf. 
[0166] 3 y^JftgP 1 5 0 {±. 

b^tff$8t&*^a51 5 ltCtS*ft$nS3^W-bWi:^N'«y^ 

mm^>'Ji^Bymmt^j:i>-hif^wm\.z-$mth. ^ 

5§f J^as 1 5 2 (i . i^^df i^'S^ 3 yffl?g i: w 
'J'^B y^^ 1 5 03&»^>cO?1l^;K>''i^ 3 ^-ffffgc^SESI 
( i: 2 JgraRi ) X'h l> *^3!)»o¥<J 

[0167] nm^m:^^-)\^mm 1 5 4 ti. 

5l*«^l:TV>i.i:^«3^JSg?l 5 2t;*3V»T*'J^§ix 
t # 3 15 0 i3--(><Dmm 



)VtLXt^mi-i>. Jgfflx^-yU-^fe^gSl 5 6{i, CO 

<Iffl^tgx^--'Ul^iWa5 1 4 5ict&tfi$it/c^^tg;?> 
^1^5 . C:oaiffl>?.^— 1 5 6 A»<i>coSlfflx 
[0168] ^<7m2 9\,z^'tn^<r>^l,zii\rx:\i^ 

nmmm^<r>mmi-h=^-mt^—!f^-Y 101 ^mmt 

t^v^J^tts. $gffl;<>^-;w^^l 5 6{i. ^a^^ 
J64,fiyt:MS'Jtw«l!ot<$ffl^«Bx^-;WtStta51 4 5tc 

[0169] [iStte<jW?iJS«?a5cO««] ^ 3 0(i:. S 

mi^¥\m{u<7)m&i:m!sikmz^^x'hh. ciois 

ttWlr^iJSlRSPJi. JSittffi»8A:*3 v^' 7 x i 6 0 

. w<7)!S14W^^JS!)?l»«. ^ i^^' 5 ^' 3 
3tSa52 6lC-^iix-i.. 

[0170] iS14W^^JS«?S5«. ®Sffl«A:t3-f 

7X-X1 6 0*>ib-^;c'oii^^tt1ff8t=:tJ!-^T*i^$ 
n;^>:JSttSr¥'JS-r-l.^tt¥<J^a5 1 6 2 i: , 

^<~J^1 6 1 fc, ^<0^f!l^ai51 62*»4>OJSSW 
fBlc«!oT^'t4ffi$g7'-:J"<.-^ 16 1 S:#B1L. Ji^ 

^titzmi&\.znm-th7.y-)v^m^L. ^mt^^m^ 

«>i>^-;WS:^l^l>1^x^-;W^a5 1 6 4 

tf. c:i7)<gfii>?.^-;P^^gl5i 6 4(i. ^^iJ^gRi 6 

27&-<i>iOfSttffifB*^ m^cox^-MzMLX . fflitW 

C«> 3K«>^^^-;HtfSfSlft»l 6 3{CtStt$il&3S:|£ 

\m^'!r~)V^^'th. y^tzH^-^X.i^tHt^k^ 

mh<i hv^om/mm'i^-Lhtvf^it^i.zit. :i<fm 

bLx^^^ixh. z<r>^. mm>\Mm e2izx*) 
^m^tihm^ii^^^y-MzM ini izmj&lx 

izmfh'S^wii^^^. 

[0171] mm=BmMiRmi. § '^.c, <^x^r- 

/l-mM^ 16 4 *»<i>col^X:>'-;Mff8t=tJ!-5Tfleffl"5r 

figx^-ywtsttiasi 6 5fc:tnrt$n-rv^S3Si£«03-K 

t=M LT ^-)Vi}^(:> 
Sa5'^-^;tSfilffl;^^— ;U«l^l 6 6tr-&tf. ISEfflX^r 

--/u^ap 1 6 6ti, io«iffli!rigj?>^--'Hs*i^si5i 6 

5 td^Xi>--;l^»^g|5 1 6 4 J: O^?*!^;'.^)^ 



(17) 



!^iB¥l 0-240 904 



[0 1 7 21 ms Hi. m&im'r-:f<-:^i6 iiz 

03 liCt3V^-C{4, e'OCr)X->-—fi' Tm i xo 1 i d i 
an Of ^ry) J . riydian7th 

(yT-fT>'7iK) J . rwhole tone(*— 
fW—y) J. rcombination dim. 
O^-t':*— v-3 >' • -r-f S-i^Ab') J , Talte 
red (3r;U^'— K) j , tJitX r hmp 5 d own 

y) J ^ix^tHzML. ^-tflSSa. Sb. Sc, S 
d, SetJil^S f **-^;t'o<tt:v^«,. 
[0 1 7 31 03 ltCi3V^T«. i<0!Stttt«i: LT, 

xo 1 i d i antJit/l y d i a n 7 t h{4BSI.V>Ep 
X^r— 7Pa 1 t e rediJj;lfhmp5do 
wnJ4BiVvEPi^$:-^;t. X'}r—J\^vfh o 1 e tone 
iJit^c omb i n a t i o n diminished 
ii'fSM (MM) 'SrEPmSr-^i.-S). c:o-^6<>^EP^C 
ti6o-C03 1 Ki^f J: ^xy-fl'tzMLtumSli: 

[01741 C:c7)03 1 tcS^-r J: a ^r— ttffifBOJ©-^, 
®ttffi|gA:>3-f >'^':?x-:^60i:LT{i, 5^'3>fX-r 
•y^A^fflV*^,*!. iOi^'g-fXx^f •;'^<0^'fb:tr|njfc 

<j tfzii r^OBK J tv>d®tt«$8*«A:ti$ix-i>« 
[01751 ttz(ii^<^m^<7)Xd^—Micr)^<r>m^i: 

[ 0 1 7 6 1 113 2(4, C:(7)I13 0tC5^-rJii1±^?"J)SlR 
Lms 2Sr#!!SLTJSH4ffi?8t:«!oyiW9iJ 

[0 1771 jS^*«46t«>i:, ®1±¥'J^I351 6 2 
{4, Stt'l«gA:*j>fi^:J':'x-:^i eoA^ic.JStt'ltfS** 
A:t)$tt/^*^*»^'fd^s (x-f -7rs6 2 0) . m 
ttmfgA:>3^ :7x-x 1 6 0*»<^^1±ffl#83&*A:>3$ 

mM<omHzm.'yXl^cr>:^ir-)i^<miR^ix^ (XT" 

•yrs 6 2 1), :icomm<^mit trti, n-Hjt^f 

i'>-ji^T«^)%&tCtt, J^^-;k 1 y d i a n 7 t 



Xir-;Whmp 5downA«S^$ilS. Z<DZ1—Vm 

y^i^-r-m7^yy^i:M.hZblz^K>. tS^OX^r- 
locox^^-yWtdM^ffl^tg-C'^rv^^&tcJi. 1^ 

[01781 stt^ij^gp 1 6 2(4. m&mmx:h^ y9 
yj^-x 1 6 oii-t^jB'&mm^x^^ixtztmi^'th 

2) . z<r>mt<r)mmt. tztutmi^x-)}-iy9 

7x— XI 6 03&*Bii5^<?>ri:<>^3^XT--f 'y^<r>^ 

c:oSttffi«A:*j-f :^:?:7x-xi6 0*> 

(iOBBS<*:t(4J;'9Bi<) , i^x^-;w^^^gpi 
6 4 (4, 3S«EXir-;Hf fgDTtggs 16 3 (itSJftSiXfc^S 
itX^Jr-zl'Sr^i: UT. ^ffiffix-r^'^-X 16 1 
Sr#BiL, fg^$ix/cJStttP8tcS:*l5-t«.X^r-;W5rfl 
ISX^-Zl-fc LX^^-t^ (Xx yrS6 2 3 ) , w<0 

3&«lR-fi*J(c^SrJ&^'f-&«^ (StB8S<^:t') , m 
«X^-;Wi^g|51 6 4(4. 3S^EX^r-;MffgtgiWg51 
6 3 $r#B^-r-S> C: i: < , JS14«?8x-^<-X 16 1 
^«JfilL-C. -eoti^$nn:J^(w**|S-r'&x^-;l^S: 

[01791 figfflX^-;W^Sg|5 1 6 6(4. i<Oi^X 
^^-/Pgll^aSl 6 4*>'i>«0l^X^r-iH»ffii£:^t& 
t , m&(r>a'- H (cit LT<$ffl^SE^rX^-;K7) 5 *>*t 
|50X^^-;WSr«!§gf -S. (X7"yrS6 24) . Z<7)m 

ffl^tgx^-;u*s«f^ 1 6 5izn,tfi^tcfzmm^mx->- 

-Mzi5\,^X. jlf?JSJ<0xy-;W*>'»r^^-^(-(4. ^ 
<r)nj$i(OX^-ji'imifi^tii> (xx-y:7'S62 5) . 
— Jti: ;t(4X^r-;Pm i x o 1 i d i a nt^tE^ 
ffl4'<7)X^-;K0i:#(c '■j:i3Bj^<j t v^diSitlffB 
*«A*$ii^wJ^(c{4*tl5cox:>r-;K4flR£L^:v\ 

a il/<$ffl^«lx^-yl^ 1 o L3&»^L 

55:v^%^(c(4. c:«ofgffix^-;Kc:gfci£i^x^-yP 
( loL*»^i^J©^(c{4lo<0X^^-;l^) *«StR$ix4 
(X7" y7'S6 2 6) . ZCO^X^-JUm^l S 6 

tcj: OJSiR$it:^x^-;u*«*Jl5«03-t«J5iSl^t:^ 
ffl$tii.x^— ;i'T'S)&i:LT. ^iSfJ^SU'v-^;! 'oix 

s (x-r<y.rs6 27 ) . imz<7)mmm^i}^. 



(18) 
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10 1 80] ^fc. JS1iffi$8A:^>f >'^'7x-Xl 6 0 

[0181] ±M(Di:d^j:m\immizm.^X:^'>--fl't: 
10 182] C^:^^'9^'i^H>'3dSa5<Oflfe<OflijR] s 

^'>a y^m<7)m^i:Wo^miz^-tmTht, z<7m 
3 3 izTfrmmi. mso iz^^-tm'&W)'^n>im^c^m 
^tm2 9 iZTTCtT-yi^ 3 ymmm^mm&(7)m&<7)m 

[0 1 83] las 3lCt3V>T. x^i^a ^WS^RSih^iQa 

h'ommm 1 5 1 i,ztm^iihf\^ hmtrm 

n^bLx . ::<7)^^y^yy=^'S(^mmTt^i^i^ 3 y (US 
m) i^i-mmiz^'th^-my'^i^i^ 3 ^sa^gs 1 5 
0 i: , }i^*>^>cojs^dti''i^ 3 ymmt^^My^i^i^ 

a y^tm 15 0 if^^^mm^i^i^ a ym&t SrSft, 

-eoji^^i^'i^s ycoWM^m^^^z biZ^ 0 . ilflg 

2i:, ^SliffJ^gpi 5 2*»^<OS5l«!ail^tCiBi6;^ 

3 y^SC 15 0 ii^t:,cr>mm^i^l^ 3 >-«fS$r#M7' 

[0 1 84] T^V-v-s^ffllR&jhWia^Ji. ^t^\,Z. Z. 

j\^m\.zist'r>x . m^-Yi,zn\^xmmm^'tr-)i^ 

-)VmMU\ 7 0 Sr#tf. x^-y^iB&igei 7 Oti. « 
ffl^fi6;^ir-;wilS'J» 15 4 

^V^J^-^(C{i. fi&ffl^«gX^r-;P^g^a5 1 7 3^{iT:?' 
■bxL=3:V\ L^>:*«-5t:filffl^|gx^r-;utSft^l 7 3 

[0185] ,®ttBm5!l«!«SWS. SSfil«A:?J>f y^ 
7x-X6 0*>^>-^;H?>*t6Si41ff«SrSttT. 
ti/cJSttS-ipJ^SSia^'MSR 1 6 2 i: . JSttf'Ma? 1 



6 2*-'^0?i^'S1±ffi#8t«eo'C^««r-:?^-:2. 
1 6 1 S:«l^t. 3®iE<ox^r-;Hffg!Sr3SiEX^-yH8 
#8*S«Aai 6 3*»<i>g!ajtTi<^iHltX^-;I^S:^t 
fC{^X^r-;l.S:^^-^i,1^X^-;U^^a51 6 4 

. iifiix 1 6 4 ii>coi^x ir-;Hf« 

\.z^'>x'm?i^^^-)vmm 1 7 s'vr ^'^xb. 

MlG<OX^r-;uS:;g8aJ-ri»^X^-;W^a51 75$: 

m^y\:i-bnm.<mm:^tt^ , iiitcio. 

^-^I'^^aSl 6 4*»^><Ofi54liX^r-;HC^j5f *X^r 

-;u*<iseffl^ttx^-;ut&ttaJi 7 3tc1®tt$#iT*-'»^ 

-:er. ^ff^:'3>f :^^7x-xi6 0«»fe<oSi 

6 4{4ij)f^Hi:-r, M^jffilg^fiefflx^-^P^^gpi 75 

ISl 7 5{4, ]Sl£O3-H<03-HJi1Wv>f-?---Clb 

17 3*>/^l-P<0Xir-;p$rSJ>?t--&. 3->'ilfiT&«^ 
i^>-ii«<0%^tC{4, X^r_;u 1 y d i a n 7 t hi* 

-;Phmp5down35*S!l?$ix«>. <$ffl^|gxt>--;W 
tSS^gCl 7 3<OX^r-;l^x^-;WSKa51 7 OtC± 0 

L'Srv^J^. «fflXi>--yP^^8P 1 7 5U. -eoitffrj 

[01861 C<0S3 3tc5^^J«Sr*!lffl-rSC: tCi: 

[0 187] [SI#A:'3^>'^'7x-xco^3e^]-S3 
4tt. vi<o%BHtctil!3«^A*-f :^^'7x-x<03Sg«9 

A:>3^>':J'7x-x{4, mWkif^'^'th:Lb<nX'%h 

7 9a~l 7 9gO#'»tC«. «l^;i^i^>'3>'**»lST 
^ix, =&^l^(C^tUW-b^ (ROOT) . 2je (2n 
d) . 3JK (3rd) . 4Jg (4 th) , 5JK (5t 

h ) . 6iS ( 6 t h ) fcJ;lX7m (7th) <^3&«8iJ^ 
T'?.*!?.. vKOlSlSl 7 9a~l 7 9gS:«^*««r^ 
i: . -5- 0!ttS$ityiMiSt:j5 t-T ^I^^Kv-V 3 :^Sr 

^'f>mL-tt£^*^^(r>m^Kzn%'fhmm^^^j^^ay^ 

ffi*«^$ii-S. Clc^^lSl 7 9 a~l 7 9 g«. SISI 

-f. MI D \ m^^^^-^hZ.bifix:%hb%»^z^ 
a^Vly a y'k^'^-fh Z. b i) t<7>T-fciXJf i 

[0i88lc:c^34 tc^-rsi^-Kv'v' 3 y^^-fh 
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I). $ttcll2 3 (B) lC^L:'i3— KF-a 1 t e re 



10 1891 
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1 »XI 


bxn 


vn 1 



[0 19 01 Ltzt^-^x. a^odr-.+:-H^i:oaas 

^S{ct5V>Tl4 r 5 J (omizwm r II I J •Ci4^:< 

1 J **M^T'on^. L/i*«-5T, n-HF-a 1 te 
mi}^m.^htii> . L3&» t . H 3 4 d sSrtt^Srfflv^n 

[0 19 11133 5(4. C:Oil^A:'3^^:J'7x-X<^ 

80 atJit^l 80bt. Ztii^com.^-^ 
y-y- 1 8 0 a i 1 8 0 b *»/i><0(4Stifgtc:ta!o 

2 i: . ::£0{3[E«il±J#S 1 8 2 i O^ffl^ix^cfiaif 

3yMIS"JSP18 4 2r#$J. C:<7)Ea^-te>'->M SOatSi 
If 1 8 O b J4, i: UiXcommt^b t KRB A>it/i«.« 
5&<;U- h^<7)^i^>- 3 ^-tc^tJEfttt^ix. MM 2: 9 0 ' 

mftimsd}i3^<D^m^i^->3yi<z. mmst i s o- 

lSm-l:>'-9-l 8 0 atJitXl 8 0 bi7):^aj-r-i>i4SffifB 

3 >'ii»"j«» 1 8 4 coiaseiai^s 1 8 2*»<c><^ia 

[0 1921 C:cDll3 5(c:5^-nf^t:rfcV^-C{i:. 

ffi^-feyi^-l 80 atJit/l 80b*ifflV^4>il-CV^i> 

[01931 C:om^-fe>-1fSrfflV^TA<50M«0^fc^^a9 

^izmm^-^i>^ti!fiX^?>, 
[0 1941 tti. h^y^ y h^j:t'<r>Xol,Z. 

SCltJ&s-C^S. ii7)h7>-'<>y hSrill^A:^-^:^:?:? 



';>iil.. -f'S:*)^. h<?5J#^. ii^. 3o<o 

± 5 iz^i^-ttm^timmjiz^^^^ ts-r j i: v ^ p it 

ti^. t3^c**ot:c:oJ:d^^:/:J':7x-x5:fUffl-r^ 

'^mcomx/^mU'rhtzMz. ^^an-h-srsiffl 

[0 1951 C:<7)h7>'<-y hiO<to'5rl!?:^^fsSrfflv» 
hm^l.zi5\^Xi,. mmmiiim^B^f.zMi¥^i^t:m 

c: k > Lfzi!}^'oxmm-t&mmiZ'^t>'±xm 

[01961 ±5*cOiKBBC*JV%T«. >^A'X<^fiP^^ 

'^x^zi-v{,zm-him^m^^'>--f\^'&MiRLx^^ 

[01971$ hf.Z. i^-^X(r>mm^m<^^^J:^^. fife 
[01981 [^<5y2 ] ±^0§lBaiCi3V'>r«. ^<7) 

mm-^m-^x^Mt. n-Y<^mmzm.'^xmi^m^j: 
El 3 4 ics^-r i o 3 y^mm^<r>m)m'S. 

t-e# ^ . •^^i5*>. ii^3&«0 3 5C^-t <k 0 
■fey-^- ( 1 80a. 1 80b) SrfflV^Ti<0?S^:K5^v^ 
3 yi&iKilWlc rpn< J c i:l;r J: 0 . -ec^jS^JJ^i^'i^ 3 
V*«?1I^Six^tc7)i: LXfm^^i^X^M.^m^'J 
£^3>'lff8*^'A:^$ni>. -r^i?^. ^g^l<7)jgia<0 

0 k LT b'7':*;<^^ 7 6 ^irLXjmmtt^E^t^ 
m^^-Lhfih, l.t^tl^-yX. vK^i^^r'JXA^Sr 

[01991 [|lit<^J^3 ] S3 dcoSKBO^ 
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vi^ 3 yimf]-thmm^'>''y 3 ymm 1 9 o sr-^ 

tf. i<o?l^;it>''j^3:^A:^3-f:^:?7x-xi8 5(i, 
1 79 a-1 79 gh, $^>l;. *S^$n^®^Sr1^ti|i 

'tmmi^fs^mSi^x:fj-t^tzib<7)mm^i^i^3y 1 9 

Oa— 1 9 0n?:-^tf. 

[0200] mmni'j'^ a ymw^ 1 9 oji, icoss^ 

^i^'i^ 3^190 a~190n t:-ftLXiS.m^i^i^ a y 

1 o<7)^tci5{t^>*;./caMigsiijig2 0 o\,znL. 

X'h'^i^^ifiifl^ay-kT^sflimifiVi^ay'mii: 

[0201] 0 on. jimmm^^m. 

8*>4><^®«fi#S:X:^jt, z<r>mm^i^i^3ymm 
1 9 0i)-^^z.hixtmm^>'=^Bym^mmi.zm'ox 

z <rtX:h LfzmiBim^zn L®migtiP5aa$:tT'5r o . ^ 
<^M«<g|IPSIg2 0 OW. Byt'^^j: 

:h^ixfzmimm9mmkfizm.'>xnm<miSimi9m 

[ 0 2 0 2 ] 123 7{i, CICOHS 6 CS^-fH^i^liP^S 

2 0 0 iJil/^§lg 1 O<o«fiSSr«lB&Wt::5^-f-0-C& 

«>. I13 7(CJ3V^T. H«<gtiti^®2 0 0{i, M^;Ki^' 

3 ymmu 1 9 o *»<c>-^i. ^>fL^ ji^^xv 3 ymiSi 
i.z'^'^xn^^ixfzmmm^izim^xm^^mm- 
hmmu2 0 0 a ^ . 7mmm/^^m.Bii^h<mmm 

■^ORd-^ (#feft-^) S-A:>3L, $IJffl!952 0 0ac7)$IJ 
ffll<7)T^^^^^g^5fta2:^T5r 3 Ri!JMSi5 2 0 0 b t . 7^11 

^i-i-) $:A:']L. *iJffllSP2 0 0 aO$iJffllcOTlw^g:>S^«l 
fi|Srfi==5rd G3!asa52 0 0 c t , 73*^m±fi^S8*» 

*Jffll8l52 0 0 aff>mmT^Z'£m^j:9m^n^J:o B^m 
U20 0 d§:#tf. Um^2 0 0 a{i. ^m^'^i^ a V 

Yt^^^zn-oXiUM^^mm^'k^'thi^^x' 

[02031 R3!aagS200b. G«raSI52 0 0c*jj: 
t^B3!aagp2 0 0dc7)#^(i:, -^x'bixJtRft^. Gfi 

<^®»m^t*.y h<7){2S^i^7 h-rSii:lcJ: OUSS? 



[02041 m^m. 1 0{4, C:<7)®tfeiifilp^B200 
i}^h^tti,tL?>Rm^: G^i-f-tJj:tfBfi-^S:Sit. W 
^C0)liifC'^X:J'^t-C^X^'»J->'l ObiitC® 

0 aji. m^<7)mm.m^^m<^mm 
mmt m^x'$> 0 . mmmmm 200 

f>{'J-^)vmmT±^ym^-^zmskLx. ^xi?>; 

- >- 1 0 b 3&«C R TT'^) S 3&\ JSSt' ^:xyv^x'hh 
i)\ ttzliM^^^v^m^vkttii^tii,:x.i!^ ')-yX'thh 

Mz^-o X ^ti^ti'jm^xmmm^fi^x'i xTmmsL 
mms.^^m7T^:^ i^v-yi oh iz^^i> . mz«m 
iz-o\,^x®mizmm-r?>, 

[02051-^, mm^ 1 ifi. ^(ofm^^i^i^ s yfm 
Lfzm^tr^L h . im^'Ji^ 3 ymmxti^ y 

^'7x-;«>18 5{4, ft<rm3Si,Z7rctXo^j:. =@^^ 

iH^^^-'v- 3 > 1 9 0 siifi. m^m^<r)^^m^'th 

2 0 Oii. UmSi2 0 0 aO$lJfflI<OTlCR5!Q!SliP2 0 0 

b ifi. im^^st^^ms *»4>#;t tyfih Re-f-<^u'<. 

;l-$:J^<t. Rft-^lS1iSr:^#<-rS. ClcOJ: # . Oi® 
Sa52 0 0cfc±t^BiJ!iaa52 0 0dtCfcV^T. Gff-f- 
fci(/Bfi^<7)U'<;P*«i£< $*i&3!!yi*«W-«irT4T5:i> 
nT&J:V). M^a^$iJ19iliBl Oati:. -^t^B^l^fili 
J|g2 0 0 tcj: 01i«iP$nTfS^*«3iP$*t:^^ffi««-^ 
Sr^LT, ^;<.^'U->'1 0bJi(c^-r€.. Z-tt 
l=J:0, ^5^X:7»J~:^1 0b±l:i4, «»1<^S* 

[0206] z<7Mi^^m>)mt vxki. mz. ^mm 

[0207] Z<r> rMaSrBBS<-rSj HXX/ rp^s- 
^ffi$8A:']i:iSlftL-CI^§n«.i:o(Cl«B£$ttTt> 

^B*«it>jEtTH«s<^r»3. wm-ri>mm^zfmviim 

^^i^-thZbifiX'th. 
[02081 $ 4>lw. Z<7^mm^i^iy 3 LT . 

mm^^-t^xo{zm^^ixxhi.\K tztuf. 75 
mmmis^^^^'i^^zii^^xM. mimi:/^2^. axt/ 

L. mmmmizmtxv$imm^t:mmiz^'thzti}^ 
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[0 2 0 9] ^rij. ^rnmi^MhK-th } tixx/ ^wm 

[ 0 2 1 0 1 $ ^>tc. ^Komm^'Ji^ 3 yizM\^nn^j: 
[0211] \.%m<r>mmA ] 03 sji. :L<r>^m<r)m. 

^mi>zm-h^n-t:^i)-tf&mmsi^^:h-ts>t:iiberm 

mx:h^2l0b. ^^7" ^ T-^tL-^tiiziPtL. ^T-f 
TSrfflV^TT- h t:m^'t^<^l>z£-^t $ix^»iS$r*S 

ifrr^^is<-^2 1 mnx:f]U2 1 o*»<i><^^ 
nxmm^mizMm-t^^'f^ r<7)mm^^m^-x 

2 1 5 *»A>#B1 L . #Bg L3^^*niJfc i Stt/cSiJtaUffS 
tClMoTpt-f TWIfiSrJnX-r-&ffi$BJPXg|52 2 0 fc. 

;i<ommittiM2 2 otci •5Jio:$n/i'tsf8S:**je<o^ 
[0212] msixti^2 1 o(i. ^7^>f r-eix-etttc: 

S*LT^»t^>*t. ^Jftf ^ TI,zmf?>T-h^^-ti> 
tzlib<7)M T -f Tli^SM # a— M # m ^XtS-t^ 7ti6<0;>< 
T >r TmmX:fl^ 2 1 0 a t . X >f T -etl-fiXtcM 

i:m'mWimc # a~C #mS:A:J3'r-S.:'i«)<0*iJ1Wffi 
^^jgP2 1 ObSr^tf. ::<0^x'-fT«f8A:^|[52 1 

izfimL. mmi^^mzt5\,^Xli. mi D I df^-*;/^ 
(iM I D I df-df- HtcW;5-r&. «iJfflHffBA:>38l52 1 

ob{±. jim^m^^mm.izi5\^xii. ni^titjimm 

t^^-t^mW'<y^-:!'l>znm-th. mmi^^mzii\^ 
[02 1 3] »]il'<.-:^2 1 #;»<x-f rSrffiffl^ 

mmm^^mz^\.^xii. =&Moi£«{ciDV^T. tjh 

Kttt. 5«ft#«»l=*3v^Tl4. io*ni6^-x2 i 5 
(4. r^N'-^j^ y -aift J < ^WiTi- U — b*(c*t*5 

[0214] mmMl.^2 2 014. TJIIMtfe^^gK 

xmmiymt^^^iznm-ti>. m&f^^mizi5\,^x 



{4, C:ottf82ioxa5{4. W;«i>J^g5tc*Jfl5-f ffi^ 
5^2 3 0»4. TJIN^fife^Jd^SfcrfeV^rti. 

[02 1 51 f^^-r-S.r-h*«, Wfcil/'iBftOfeSrfflV'ii, 
^^-X2 1 5CJ4. -e«Oi^ffiSrf^^-r-S./^«6cO 

yi(4-b-r >- ^ ii'OrJ' «y ^lwifi< f , =2: t'ij^h ^ , 
[0216] icO^S aiZ^J: o^'7JUi-:^'r^ T • 
T-hSgf^^Stci3V^T. mm}saJM2 2 0ifi. "fi^ 

m^titz^m^mm- h^(^-x2i 3 irm^Lx. 

tikini. mm^mzt5\.yx . ^amm^^mz^ o . 
^mmmizht:'^xmmmiii^^x<r>mMimmmiz-:>\,^ 

i,fzib. mmiiz^:hi}'X'^ . m^izmL<o^7' ^T^ 
h {4-^O^Srifg;t Cl t *««iE$ix-Cfc 0 , 

&kLX'^-r~^cr>shnym^Mm-hzti!fiT^ . ^ 

**-5T. h&mmz 1 o<0;>{-r -f rtwi:«>r- b^mc 

y>, LX(r>i^^co^^^y:^i}^:k^<mix^Ztli 
Cic5Daii$^-x2 1 5twlStt§<x4^1«4. 

m^'htnix<. mi¥mcomi¥mm^7§imHz^ii: 
^^XTMzt5ifhmmMiR(r>mmmcfy^^m) . 

[0217] 1f?8JPXa?2 2 0J4. ^x >f r^l>?iC. « 
^-X2 1 Scof^mcrm^^mMLX . M^ScO^x-f 

WfgJaxa52 2 0{4. rSi0r-b<0pfPS:«-5 

xmm<^MJiti^^^i>tii> i d cfltj^t^n-c t ± v^. 

[0 2 18] 
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i>^im^tixt5>o. Ltziji-yx. i om^^m^ 
'^■stth^tii+^iz^mx'i)?,, vtiv-^x. zith 

[02 191 tfz. v;u^^T-fT • r-hni¥mmiz 

s-#«!StT, mmmmaxif^mLfz^mzm^^^xx 
LXMxmgnzu-yxim^m^h ^itizx*). v^-r 

itcr>^ T -f Tic i ^ r- h t Sr* L3{)»o^f*c 

i: LX0-r-^coffamA(m^^Lti>'OT-hmSl,M<^\i 

mil :i(^^mzmo ^jtjv-^^m.- -^ji^^r'^r 

[02101 iZ7ik^7mm.m^^m.<omFcovmi:^ 
•ryu-^^-hmx'hi>\, 
msi mi^2ik<Dm^izictm-t^7mmm±^m<^ 
imi:mmt&ttif><7imi^x'h& . 

[05 1 M<7)^t#t^L^rV^Ka^>'^•^'-:^0^3^ 
i:7P'tWi±MX'$>h. 

[06 1 M^0J^*i:3^'rs>'^•^-:^<0^^RJaS^r^■r 

[07 1 W!}'4ik<7)m^(r>7mmm(7)^mmi:^-m 

tb(Dya—i-^-hmX'h?>, 

[09 1 -'m!m:EAmjm<r>wmm.)^-izm^\^t:7f 

[010109 \zm-7immm>^imm^\zi. him 
ms^^U'kTkm^x-h h . 

[01 1 1 09tC5^-t7niM«S:^i--5^«x^73fNi 

[01 2\wMf^^-y^<m3iM^¥s^m'tm±m 

X'hh, 
-0TJ5I). 



[014109 t5^-r73llMife^<Ofcy><0«)#S:^Bg 

^hf^2(r>Wdmx'hh. 

[015] :^ni^«i^Ji^fgcom 2 0^fl?i|0«j£SrS^ 
[016101 StS^-TTTHMm^fe^Sfcil/rj^e 
S. 

[0171 01 8(c*-rfll^<^i6#S:^7a-f-v- 
h0T'*>i.. 

[0181 01(c^-rMSS:Si^X-rAS-#tf?S^iSJK 
[019101 tc^-f M^iai^X-7^A<^«(£2rmW 

t=5^-r0T'j>i>. 

[0201019 eiftT-^ U jf <^««SrlSlB&W 

tcs^-r0T'S)^. 

[02 1 1 02 0(c5^-rafi)Ti-U— JfiCJ: OJ^Pf^it 
[0221019 fclS^-r^Si«'J^ai50«lRS:IRBSWt:^ 

-r0-eS)-g., 

[02 31 (A)i3j;i;^(B) (i;2.^r_^kc7)W^J<OtR44c 

[0241022 t^-r^i^v- 9 ^-/mssj^ftJtast^ 

[0251020 (cs^f sar-^ U -*ro3£H0!lO«*R 

^mmiZTFcfmx'hh. 

[02 61 02 5tCS^-rSl!jri-U— «f<^3— 
iW^S:5rr 7 o-0-C'3^& . 

[02 71 01 9C^-r-fi^^9^'i^g>^Sa50«^ 

5r«tB&Wtc5^-r0-r'S>^. 

[02 81 02 7C^'^-r>'i^3 >'/';^y— ;l'T— T'/W 
tclSlrt$*t^-r-r;PcOl8jRO--0yS:^-r'0t'J>«. . 
[02 91 02 7tC^-r^>'^9^a^3 V^SSt5<^^3e 

0!lco^s^^«ltll^&w^^^^-r0T'*i. . 

[03Ol^>':J'^i?v'3 ^iJSSaSfO^W^^SlRIK 
<O«Ji£Srllli«SWt;:^-r0T'S>& . 
[03 1 1 03 0CS^-rSttfl!«7*-:?'<-.:^i=tilrt$ 

[03 21 m3oi>z^-^mmmnmtK^(r>wn^^^ 

[033My^'9^£^a >^m^<^com&t:mfm 

i,z^-ry^-y^mx'$>?>> 

[03 4 1 mmx:f}^ y^yj:—:x.<D^m<om&^m 
vk^iz^ctmx:hi>, 

[03 51 03 4lC^-r?1l?IA:'3-f :^^'7x-X<^^!3g 

m<7)mi^mi:7n-tmx'h?>, 

[0361 C cO^Bfltcta! 5 -r-f T • r- hS8f^ 

[®3 7 1 03 6tC5^-rffl«igflti^SOflt«Sr«lB&Wtw 



(23) 



0-24O9O 



1 mmm 

2 

4 JS^^S^Xt^A 

6 ;>&;<5 

8 77»iHi^^lH 

1 0 ^?F^S. 

14 •y^';^4fe^§ia 

10 1. 10 2 K 
103 !7-^»:^-f— S^3>' 

104 

105 -^-n^^-K^i^'jL— ;U 

106 ryr/;^^-;"* 
110 mT—^f-^^-:^ 

12 0 jii$3dii^;^T^-^ 

122 a»TtU-Hf 
124 iPlgfiJ^^ 
124 a »p:Wiemt&Wg|5 

124 b m.mnii^'i^3>y''^^mm^ 

126 >fy^'7^'£^3:^^JIl!B 

126a xy-;P/x:^>'g>^l51W«tSlfta5 

122 a a-YM^fmSli 

12 2b /t—Zl^T"— I'^/W 

122 c Xir-jum^ 

134 a jSmi^mtStASi: 

134b fiM;2>^-;l^!>?a5 

134 c 3 y/^^mWSe 

134d ^^^$8^Si: 

132 a n-K^-fb^ajS? 

132 b a-KiS^S 



13 2c 3- Vf—yJi^ 
140 T^^i^a^^JS'iSP 

14 1 «g|3-h'tS«rtai5 
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Abstract 
Problem 

To provide a multimedia art-producing device that can readily produce harmonious hnages 
and music simultaneously. 



Means to solve 

The movement of performer (1) is imaged with camera (6), The imaging signal is extracted 
and a kaleidoscopic image is generated by kaleidoscopic image generator (8) and displayed on a 
screen by display device (10). The performer also perfonns with the support of a performance 
support system (4) with a portable musical instrument. The performance support system analyzes 
the time series transition situation of the chord information for a musical composition, assigns a 
usable tone series for each chord, assigns usable pitches to multiple performance positions for each 
chord according to the assigned tone series information, and generates pitch information according 
to the performance input information from the player and the pitch assignment information to 
generate audible sound. A novice can easily generate music and video that are above a standard. 



— t 




Performance support system 
Camera 

Kaleidoscopic image-generating device 
Claims 

1. A realtime multimedia art-producing device provided with: a musical composition 
analysis means into which chord information for a musical composition is input and that analyzes 
the time series transition situation for the aforementioned chord information and assigns a usable 
tone series for each chord, 

a first performance input means that has multiple performance positions and that receives 
from the performer, performance input information through the aforementioned multiple 
performance positions, 

a pitch assignment means that assigns usable pitches for the aforementioned multiple 
performance positions for each chord according to the tone series information assigned for each 
chord from the musical composition analysis means, 

a sound-generating means that generates pitch information according to the performance 
mput information from the aforementioned performance input means through the aforementioned 
multiple performance positions and the pitch assignment information from the aforementioned 
pitch assignment means, and converts said generated pitch information to audible sound and 
outputs it, 

an imaging means that converts the optical image picked up for the aforementioned 
performer into an electric imaging signal, 
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an image extraction means that receives the aforementioned imaging signal and cuts out a 
partial imaging signal corresponding to a region designated on the image screen in the 
aforemeritioned imaging signal according to extemal instructions, 

an image-processing means that uses the aforementioned partial imaging signal as the 
original image, that inverts and reproduces it using the boundary lines of the aforementioned 
designated region as the mirror image symmetry axes to generate a mirror image, and that repeats 
the same operation for said generated mirror image in order to generate an image signal to fill the 
screen with mirror images, and a display means that outputs and displays the corresponding image 
in response to the output of the aforementioned image-processing means. 

2. The realtime multimedia art-producing device described in Claim 1 wherein the 
aforementioned image extraction means includes a means that cuts out a partial imaging signal in 
the aforementioned imaging signal corresponding to a designated polygonal region according to 
the aforementioned extemal instructions, 

and the aforementioned image-processing means include a means that repeatedly generates 
thie aforemeritioned mirror image for each side of the aforementioned polygonal region. 

3. The realtime multimedia art-producing device described in Claim 1 wherein the 
aforementioned image extraction means includes a means that cuts out an imaging signal 
corresponding to a region at a designated angle and uses a designated point in the imaging screen 
as the center point according to the aforementioned extemal instructions to generate the 
aforementioned partial imaging signal, 

and the aforementioned image-processing means uses the aforementioned partial image 
signal as the original image, and inverts and reproduces it in sequence according to a prescribed 
direction of rotation around the aforementioned center point with the side toward the 
aforementioned direction of rotation being used as the mirror image symmetry axes to generate 
mirror images. 

4. The realtime multimedia art-producing device described in any of Claims 1 to 3 that is 
further provided with an image-synthesizing means that synthesizes the graphic image generated 
according to extemal instmctions with the partial imaging signal cut out by the aforementioned 
image extraction means, and that changes said synthesized partial imaging signal into the partial 
imaging signal from the aforementioned image extraction means and gives it to the 
aforementioned image-processing means. 

5. The realtime multimedia art-producing device described in any of Claims 1 to 4 wherein 
the aforementioned pitch assignment means includes a means that assigns pitches having the same 
junction in the corresponding tone series for each chord to the same performance position among 
the aforementioned multiple performance positions. 



6. The realtime multimedia art-producing device described in any of Claims 1 to 5 wherein 
the aforementioned pitch assignment means includes a means that selects one type of tone series 
according to the result of analysis of the aforementioned time series chord information, according 
to predetermined rules when multiple types of tone series can be assigned to one chord and assigns 
each of the pitches included in said selected tone series to a predetermined performance position 
among the aforementioned muhiple performance positions. 

7. The realtime multimedia art-producing device described in any of Claims 1 to 6 that is 
further provided with at least one second performance input means that has multiple performance 
positions for inputting performance information and that generates pitch information 
corresponding to the performance information input through the multiple performance positions, 

and a lindting means for receiving the input pitch information from the aforementioned 
second performance input means and limiting the pitch assignment operation by the 
aforementioned pitch assignment means so that a tone series other than a tone series that includes 
pitches inharmonic with the input pitches from the aforementioned second performance input 
means will be selected, according to predetermined rules from the usable tone series assigned to 
the aforementioned first performance input means. 

8. The realtime multimedia art-producing device described in any of Claims 1 to 7 that 
further includes a means for assigning sensitivity information to each tone series in multiple tone 
series groups, 

an input means for inputting the sensitivity information, 

and a means that determines usable tone series according to the sensitivity information 
iiiput from the aforementioned input means and the sensitivity information assigned to each tone 
series when multiple tone series groups are assigned to the aforementioned chords, 

and the aforementioned pitch assignment means includes a means for assigning the usable 
tone series determined by the aforementioned determining means to multiple performance 
positions in the aforementioned first performance input means. 

9. The realtime multimedia art-producing device described in any of Claims 1 to 6 that is 
further provided with a second performance input means that has multiple performance positions 
and inputs performance input information through the multiple performance positions, and a 
means for inputting sensitivity information, 

the aforementioned musical composition analysis means assigns a usable tone series to 
each chord from multiple tone series groups to which sensitivity information has been assigned 
accordmg to predetermined rules for each, 

and the aforementioned pitch assignment means includes a means that selects a tone series 
from the aforementioned usable tone series that is harmonious with the pitch information from the 
aforementioned second performance input means and that has sensitivity information 



corresponding to the aforementioned input sensitivity information according to the analysis result 
of the aforementioned musical composition analysis means, pitch information from the 
aforementioned second performance input means and sensitivity information input froni the 
aforementioned sensitivity information means, assigns each of the selected tone series to multiple 
performance positions in the aforementioned first performance input means and assigns pitches 
with the same function in the tone series that will be usable for each chord to the same performance 
position of the multiple performance positions in the aforementioned first performance input 
means. 

10. The realtime multimedia art-producing device described in any of Claims 1 to 9 
wherein the aforementioned first performance input means includes an operation recognition 
means that specifies performance positions among the aforementioned multiple performance 
positions with an operation by the aforementioned performer. 

11. The realtime muhimedia art-producing device described in Claim 10 wherein the 
aforementioned multiple performance positions include multiple second performance positions, 
with prescribed image processing assigned to each, 

and that there is further included a means that changes the image displayed by the 
aforementioned display means with the manner of processing assigned to a specified second 
performance position according to information specifying said second performance position input 
from the aforementioned first performance input means. 

12. A multimedia art-producing device that is a multimedia art-producing device that can 
generate products using multiple media, 

which is provided with an information input means furnished corresponding to each of the 
aforementioned multiple media for inputting media information for expression using the 
corresponding media and control information for stipulating the conditions corresponding to said 
expression, 

a knowledge base for storing the knowledge required for expression using each of the 
aforementioned media, 

an information-processing means that receives the media information and control 
information from the aforementioned information input means, references the corresponding 
knowledge in the aforementioned knowledge base, and processes the aforementioned media 
information based on the referenced knowledge, and an information-presentation means for 
presenting the information using the corresponding media according to the processed informatibn 
from the aforementioned information-processing means. 
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Detailed explanation of the invention 
[0001] 

Technical field of the invention 

The present invention relates to a multimedia art-producing device. In particular, it relates 
to a device for generating video and music simultaneously in.real time with computer assistance. 

[0002] 
Prior art 

Many realtime multimedia art-producing devices with the objective of generating video 
and music simultaneously have been proposed in the past. For example, there is a product called 
"Recollections" produced by Ed Tannenbaum. In "Recollections," the human form is 
photographed with a video camera, the appearance of the imaging information from the video 
camera is changed with a computer, a silhouette of the human body is projected with stop motion 
that changes moment by moment from the rear of a screen, and the color of the silhouette changes 
to the colors of the rainbow. 

[0003] 

This type of realtime multimedia art-producing device, in addition, includes the system 
using "pfmder" of the MIT Media Lab (research center) and the "Brush de Saniba" system of the 
MIT Media Lab. 

[0004] 

Problems to be solved by the invention 

In conventional realtime multimedia art-producing devices, it is possible to produce video 
and music simultaneously. For example, in "Reflections," the video changes to correspond with 
human movement, and the color and sound also change, but the manner of change is determined by 
a program, such as a continuous stop-motion image, for example, and the manner of change is 
fixed. The sound also changes to correspond with change in movenient, that is, music is composed, 
but if movement is carried out while concentrating on video change, the music composition will be 
neglected, and, conversely, if concentrating on changes in sound, movement will be neglected, and 
the problem occurs of a drop in the standard of the produced video. In the same way, even in 
"Brush de Samba," the video changes due to a pen being moved on an input pad to a samba rhythm, 
but if the video being created is given importance, the musical performance will be neglected. 
Conversely, if one concentrates on the musical performance, the mind does not concentrate on the 
video being created and the [quality] level of the produced video drops. 
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[0005] 

That is, in existing reahime multimedia art-producing devices, while simultaneous creation 
with multiple media is possible, the problem has been that it is difficult to create above a fixed 
standard using multiple media. That is, in existing realtime multimedia art-producing devices, 
while the multiple media have mutual relevance, the problems are that the control of each medium 
is largely independent, it is easy for differences in quality balance to occur between the media in 
the produced art, and it is diflficuh to achieve harmony in the overall product. . 

[0006] 

For this reason, the objective of the present invention is to provide a realtime multimedia 
art-producing device that can easily produce music and video that simultaneously have a quality 
above a certain standard. 

[0007] 

Another objective of the present invention is to provide a realtime multimedia 
art-producing device with which even a novice can easily create a product above that level. 

[0008] 

Still another objective of the present invention is to provide a multimedia art-producing 
device that will be harmonious overall using multiple media and with which the art produced with 
each medium will have a quality above a fixed standard. 

[0009] 

Means to solve the problems 

The realtime multiniedia art-producing device pertaining to the first viewpoint of the 
present invention includes: a musical composition analysis means into which chord information 
for a musical composition is input and that analyzes the time series transition situation for the 
aforementioned chord information and assigns a usable tone series for each chord, a first 
performance input means that has multiple performance positions and that receives fi*om the 
performer, performance input information through the aforementioned multiple performance 
positions, a pitch assignment means that assigns usable pitches for ttie aforementioned multiple 
performance positions for each chord according to the tone series information assigned for each 
chord from the musical composition analysis means, a sound-generating means that generates 
pitch information according to the performance input information from the aforementioned 
performance input means through the aforementioned multiple performance positions and the 
pitch assignment information from the aforementioned pitch assignment means, and converts said 



generated pitch information to audible sound and outputs it, an irnaging means that converts the 
optical image picked up for the aforementioned performer mto an electric imaging signal, an 
image extraction means that receives the aforementioned imaging signal and cuts out a partial 
imaging signal corresponding to a region designated on the imaged screen in the aforementioned . 
imaging signal according to external instructions, an image-processing means that uses the 
aforementioned partial imaging signal as the original image, inverts and reproduces it using the 
boundary lines of the aforementioned designated region as the mirror image synmietry axes to 
generator mirror images, and repeats the same operation for said generated mirror image to 
generate an image signal to fill the screen with mirror images, and a display means that ou^uts and 
displays the correspondmg image in response to the output of the aforementioned 
image-processing means. 

[0010] 

The image extraction means includes a means that cuts out a partial imaging signal in the 
imaging signal corresponding to a designated polygonal region according to external instructions. 
The image-processing means includes a means that repeatedly generates a mirror image for each 
side of the polygonal region. 

[0011] 

In place of this, the image extraction means includes a means that cuts out the imaging 
signal corresponding to a region at a designated angle and uses a designated point in the imaging 
screen as the center point according to the aforementioned external instructions to generate the 
aforementioned partial imaging signal. The image-processing means includes a means that uses 
the partial imaging signal as the original image, and inverts and reproduces it in sequence 
according to a prescribed direction of rotation arovmd the aforementioned center point with the 
side toward the aforementioned direction of rotation being used as the mirror image symmetry 
axes to generate mirror images. 

[0012] 

Also, preferably, there is further included an image-synthesizing.pieans that synthesizes 
the graphic image generated according to extemal inshnctions and the partial imaging signal cut 
out by the aforementioned image extraction means, and that changes said composed partial 
imaging signal into the partial imaging signal from the aforementioned image extraction means 
and gives it to the aforementioned image-processing means. 
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[0013] 

The pitch assignment means also includes a means that assigns the same function in the 
corresponding tone series for each chord to the same performance position among the multiple 
performance positions. 

[0014] 

In place of this, the pitch assignment means includes a means that selects one type of tone 
series according to the analysis result for the time series chord information according to 
predetermined rules and assigns each of the pitches included in said selected time tone series to a 
predetermined performance position among the multiple performance positions, when multiple 
types of tone series can be assigned to one chord. 

[0015] 

Also, preferably, there is further included at least one second performance means that has 
multiple performance positions for inputting performance information and generating pitch 
information corresponding to the performance information input through the multiple performance 
positions, and a limiting means for receiving the input pitch information from the aforementioned 
second performance input means and limiting the pitch assigmrient operation by the 
aforementioned pitch assigimient means so that a tone series other than a tone series that includes 
pitches inharmonic with the input pitches from the aforementioned second perforinaince input 
means will be selected, according to predetermined rales from the usable tone series assigned to 
the aforementioned first performance input means. 

[0016] 

Also, preferably, there are additionally included a means that assigns sensitivity 
information to the tone series in each multiple tone series group, and a means that determines the 
usable tone series according to the sensitivity information input from the ioput means and the 
sensitivity information assigned to each tone series when multiple tone series groups are assigned 
to a chord. The pitch assigiunent means further includes a means for assigning the pitehes in the 
usable tone series determined by the determination means to multiple performance positions. 

[0017] 

Also, in place of this, a second performance input means into which performance input 
information is input through multiple performance positions and a sensitivity information inptit 
means are further included. The musical composition analysis means includes a means that assigns 
a usable tone series to each chord from the multiple tone series groups to which sensitivity 
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information has been assigned according to predetermined rules. The pitch assignment means 
includes a means that assigns a tone series that harmonizes, with the pitch information from tihe 
usable tone series from the second performance input means according to the analysis result of the 
musical composition analysis means, pitch information from the. second performance input means 
and sensitivity information input from the sensitivity information input means and that has 
sensitivity information corresponding to the input sensitivity information, and assigns each pitch 
included in the selected tone series for the multiple performance positioas in the first performance 
input means and assigns the pitches with the same function in the tone series that will be usable for 
each chord to the same performance position of the multiple performance positions in the first 
performance input means. 

[0018] 

The first performance input means also includes an operation recognition means that 
specifies performance positions among the aforementioned multiple performance positions with 
an operation by the aforementioned performer. 

[0019] 

The first performance input means includes multiple second performance positions with 
prescribed image processing assigned to each, and includes a means that changes the image 
displayed by the aforementioned display means with the inanner of processing assigned to a 
specified second performance position according to information that specifies said second 
performance position input from the aforementioned first performance input means. 

[0020] 

The performer can always perform using the theoretically correct tones, even when he has 
absolutely no theoretical knowledge of the pitch transitioiis during the performance, by assigning 
the usable pitches for each chord and assigning each of the pitches assigned to a tone series to 
multiple performance positions in the performance input means. The usable tone series for each 
chord is also generated based on the result of analysis of the time series transition situation of the 
chord information, the tone that has the required fimction for each chord can easily be used, and 
the feel of chord progression can be conclusively expressed, while, conversely, a performance that 
intentionally obscures chord progression can also easily be expressed, greatly increasing the 
degree of freedom of performance. Therefore, even a novice can easily produce music above the 
standard level. 
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[0021] 

Also, after the optical image information picked up from the performer is converted into an 
electrical imaging signal, by extracting the imaging signal, creating a partial imaging image, and 
generating a kaleidoscopic pattern image signal, a kaleidoscopic pattern corresponding to the 
performer's movement can easily be generated. For the kaleidoscopic image, the size of the partial 
imaging region unit can be designated according to external instructions, the pattern can be 
changed easily, and video above the standard level can easily be created. 

[0022] 

The performer also simply has to move with the performance and the basic kaleidoscopic 
pattern for the image created is determined by the partial imaging signal that is to be the [repeated] 
unit according to external instructions, and the detailed composition is changed by the movement 
of the performer. Therefore, video that is harmonious with the music performance can be created 
by the performer moving to the music, and both music and video of a higher quality than the 
standard level can easily be generated simultaneously. 

[0023] 

The multimedia art-producing device pertaining to the second viewpoint of the present 
invention generates productions using multiple media, and is provided with an information input 
means furnished correspondmg to each of the aforementioned multiple media for inputting media 
information for expression using the corresponding media and control information for stipulating 
the conditions correspondmg to said expression, a knowledge base for storing the knowledge 
required for expression using each of the aforementioned media, an information processing means 
that receives tiie media information and control information from the aforementioned information 
input means, references the corresponding knowledge in the knowledge base, and processes the 
aforementioned media information based on the referenced knowledge, and an 
information-presentation means for presenting the information using the corresponding media 
according to the processed information from the aforementioned information processing means. 

[0024] 

The knowledge required to produce art using the media is stored in the knowledge base. 
The information processing means processes the input media information using the knowledge in 
the knowledge base. Therefore, it is not necessary for the user to control all the media control 
elements when using a certain medium, and the load when producing art with said medium is 
reduced. The information processing means processes information based on the knowledge in the 
knowledge base, so art of the same level as that obtained with full spec (including all control 
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elements), is created with a small amount of input information. The result is that the amount of 
thought and the amount of manipulation by the information input means necessary to create good 
art for each medium is reduced and cognitive overload is eliminated. So, the producer can have . 
energy to spare, multiple media can sunultaneously be used effectively, variation in quality in the 
art between media can be lessened, and harmonious multimedia productions can be generated. 

[0025] 

Embodiment of the invention 
Overall configuration 

Figure 1 is a block diagram schematically showing the overall configuration of a realtime 
multimedia art-producing device conforming to the present mvention. In Figure 1, the realtime 
multimedia art-producing device includes a portable musical instrument (2), a MIDI guitar, for 
example, as the performance input means that has multiple performance positions and that 
generates performance input information that performer (1) inputs through multiple performance 
positions, and a performance support system (4) that receives the performance input information 
fi"om portable musical instrument (2), and that applies prescribed processing, generates pitch 
information, and converts it to audible sound and outputs it. The constitution of performance 
support system (4) will be explained in detail below; it assigns pitch information to the 
performance positions of portable musical instrument (2) according to each chord progression to 
correspond with the musical composition performed by performer (1). Even when performer (1) 
does not know the theory concerning the chord progressions in the musical composition to be 
played, [the system] supports the performance so that the correct performance will be played. 

[0026] 

The realtime multimedia art-producing device further includes a video camera (6) as the 
imaging means that photographs performer (1) and converts the optical image obtained to an 
imaging signal, a kaleidoscopic image-generating device (8) that receives the imaging signal from 
video camera (6) and generates an image signal in a kaleidoscopic pattern, and a display device 
(10) that receives the image signal fi-om kaleidoscopic image-generating device (8) and displays 
the corresponding image on a screen. The constitution of kaleidoscopic image-generating device 
(8) will be explained in detail below; it generates kaleidoscopic images (indicated by (S) and (S*)) 
on the display screen (screen) of display device (10). The partial region that is the basic unit of the 
kaleidoscopic image can be designated externally. 
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[0027] 

In the realtime multimedia art-producing device shown in Figure 1, performer (1) performs 
using portable musical instrument (2) with the support of performance support system (4), and by 
operating to correspond with the performance, the kaleidoscopic image generated on display 
device (10) is changed to correspond with the movement of performer (1). Therefore, by operating 
to correspond with the musical composition performed by performer (1), the kaleidoscopic image 
generated on display device (10) becomes an image that is hannonious with the musical 
composition performed. Performance support system (4) will also be explained in detail below, but 
even a novice can easily correctly perform the musical composition and can produce music above 
a standard level. And for kaleidoscopic image-generating device (8), the size of the extracted 
region of the imaging signal from video camera (6) can be designated externally by the performer 
or producer. Therefore, the pattern generated on display device (10) can easily be changed, a 
kaleidoscopic pattern can be generated to correspond with the movement, and video higher than a 
standard level can be displayed on display screen (10). Therefore, video and music can be 
produced that are both higher than a standard level and that can be generated simultaneously, 
easily, and harmoniously with each other. The constitution of each part will now be explained in 
detail. 

[0028] 

Embodiment 1 

First, the electronic kaleidoscope device constituted by video camera (6), kaleidoscopic 
image-generating device (8) and display device (10) will be explained. It is assvmied that the object 
photographed by video camera (6) is all or part of performer (1) or that portable musical 
instrument (2) held by performer (1) will be photographed. 

[0029] 

Figure 2 is a flow chart broadly showing the processing flow the electronic kaleidoscope 
device. Operation for generating a kaleidoscopic image will be explained below referring to 
Figure 2. 

[0030] 

First, the arrangement of mirrors relative to kaleidoscopic image-generating device (8) is 
input externally (step S 1 02). 
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[0031] 

Next, in order to produce dynamic change in the kaleidoscopic image^ the parameters for 
the time interval and the angle by which it is changed when a mirror is moved (the angle between 
two mirrors is changed) in the set time interval are input (step S I 04). 

[0032] 

Next, kaleidoscopic image-generating device (8) calculates the shape parameters to extract 
the imaging signal from the video camera according to the given mirror arrangement information. 
The shape of the part for cutting out (extracting) from the imaiging signal from video camera (6) to 
generate a kaleidoscopic image is established by this calculation (step S106). 

[0033] 

Next, kaleidoscopic image-generating device (8) extracts an image signal corresponding to 
the shape of the image piece calculated at step SI 06 from the imaging signal from video camera 
(6) and generates an image signal with a kaleidoscopic pattem (step S I 08). 

[0034] 

Figure 3 is a conceptual diagram for explaining the kaleidoscopic image-generation step 
(step S108) in Figure 2. 

[0035] 

In Figure 3, a fan-shaped region (S) in which the center angle is 0 and the center point is 0 
is extracted from the image input to kaleidoscopic image-generating device (8) picked up by video 
camera (6) and input into kaleidoscopic image-generating device (8) based on parameters input 
externally. In this case, the two opposing sides that give center angle 0 correspond to the mirrors in 
the kaleidoscope. 

[0036] 

Next, a kaleidoscopic image is generated in the manner below based on region (S) 
extracted from the input image signal. That is, in the output image, an image signal extracted from 
region (S) is arranged at position 0 using point (P) as the center point. Next, image information in 
which the image information for region (S) is inverted is generated in sequence,, clockwise, for 
example, (indicated by the arrow in the figure). That is, inverted image (S*) is generated at position 
1 using the side of region (S) toward the direction of revolution of a clock shaft at position 0 as the 
mirror image symmetry axis. Next, unage information in which the image information at position 
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1 is then inverted is generated as position 2 using the side of image information (S*) at position 1 
toward the direction of revolution as the mirror image symmetry axis. 

[0037] 

Inversion and reproduction processing as above is repeated, and generation of the 
kaleidoscopic image is completed by images for all arrangements corresponding to one generated 
revolution. 

[0038] 

With the example shown in Figure 3, 0 = 45^ so a total of eight of these images, including 
the original image, will be generated. Furthermore, when the image information at position 0 
where the original image is arranged is represented by (S), the image generated at position 1 will 
be information (S*) in which image information (S) is inverted. In addition, the image information 
generated at position 2 returns to the original image information (S) by the double inversion. This 
type of processing is repeated in sequence^ so the image information generated for each region at 
positions 0-7 will be the image information [produced by] inverting original image (S) is rotated 
alternately by the corresponding angle. 

[0039] 

That is, with the example shown in Figure 3, an image corresponding to a kaleidoscope 
pattern can be generated merely by processing to invert original image (S) and processing to rotate 
around center point (P) by the prescribed angle. 

[0040] 

As above, a kaleidoscope pattern can easily be generated just by repeating inversion and 
reproduction processing for original image (S) extracted from the input information. 

[0041] 

When the number of mirrors is three or more 

In the explanation above, a method for generating a kaleidoscope pattern corresponding to 
a case where two mirrors are arranged in a conventional kaleidoscope was explained. 

[0042] 

More commonly, there are also kaleidoscopic images generated in the shape of a polygonal 
column with a kaleidoscope that has reflecting surfaces on the inside. 
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[0043] 

Figure 4 is a conceptual diagram showing a kaleidoscopic image generated, when three 
mirrors are arranged in a triangular column shape with the bottom surfaces in an equilateral 
triangle form. 

[0044] 

In Figure 4, the regular triangle form enclosed by the thick line is the ori^al image 
(represented by 0). The mirror images generated by original image 0 being reflected by mirrors (A), 
(B) and (C) are represented by 1. In the same way, the reflected pattern generated by however 
many times it is reflected will be represented by the number corresponding to the number of 
reflections, such as representing by 2 the mirror images generated by the mirror images 
represented by 1 being reflected by mirrors (A)-(C). 

[0045] 

As shown in Figure 4, in an actual kaleidoscopic image, the boundaries of the mirrors as 
indicated by dotted lines in the figure (corresponding to the design of the triangular column) and a 
reflection pattem at the boundaries represented by the dot-dash line are present 

[0046] 

As will be explained below, the reflection pattem (path) formed by each pattem will differ 
with the dotted lines and dot-dash line as boundaries. A synopsis of that will be explained briefly 
below. 

[0047] 

Figure 5 shows the reflection paths from original image 0 for patterns that do not intersect 
with the boundaries of the aforementioned mirrors nor with their reflection patterns (indicated by 
4p in the figxire), from among the patterns generated by reflection. 

[0048] 

That is, as shown in Figure 5, first-time reflection pattem (Ip) is generated by original 
image 0 being reflected by mirror (A) and second-time reflection pattem (2p) is generated by 
reflection pattem (Ip) being reflected by mirror (C), Third-time reflection pattem (3p) is generated 
by reflection pattem (2p) being reflected by mirror (B), and the corresponding reflection pattem 
(4p) is generated by reflection pattem (3p) being reflected by mirror (A). 
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[0049] 

Figure 6 shows the reflection path when a reflection pattern is present on the boundary line 
of a mirror. 

[0050] 

In Figure 6, reflected images generated by two passes with the mirror boundary as 
boundary are represented by (3q) and (3p), respectively. 

[0051] 

First, considering reflection pattern (3q), reflection pattern (I q) is generated by original 
image 0 being reflected by mirror (B) and reflection pattern (2q) is generated by reflection patfem 
(Iq) being reflected by mirror (A). Reflection pattern (3q) is additionally generated by reflection 
pattern (2q) being reflected by mirror (B). 

[0052] 

In contrast to this, reflection pattern (Ir), generated by original image 0 being reflected by 
mirror (A), is reflected by mirror (B) and reflection pattern (2r) is generated, and reflection pattern 
(3r) is generated by reflection pattem (2r) being reflected again by mirror (A). 

[0053] 

Therefore, even when a kaleidoscopic image generated with a kaleidoscope in the form of a 
triangular column as above is generated electronically, reflection of the actual optical images can 
be faithfully reproduced as explained above. 

[0054] 

However, with a generation method as above, calculation will become complicated and the 
generation speed will be slow. So it is not suited to generating kaleidoscopic images in real time, 
for example. 

[0055] 

So, returning to Figure 4, to generate a kaleidoscopic image such as this, the same type of 
kaleidoscopic image can be generated if the pattem is generated with a technique as below without 
recognizing the mirror boundaries and their reflection pattem. 
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[0056] 

Namely, for original image 0, each side of the equilateral triangle enclosing it is used as an 
axis of symmetry and reflection patterns 1 are generated by inverting and reproducing. Next, 
reflection patterns (2) are generated by inverting and reproducing the pattern using each side 
enclosing reflection patterns (1) as a reflection symmetry axis. In this case, one side of reflection 
pattern (1) touches original image 0, so for reflected images generated to overlap original image 0, 
[the system] is configured to give original image 0 priority in display. Or, for regions in which 
original image 0 is present, second reflection patterns can also be generated with a rule that will not 
perform inversion and reproduction. 

[0057] 

Next, a third [-time] reflection pattern is generated with a second [-time] reflection pattem 
inverting and reproducing the pattem using each side enclosing it as a symmetry axis. In this case, 
as described above, when reflection patterns occur that overlap patterns with a smaller number of 
reflections in the reflection pattem, the pattem with the lower number of reflections is 
preferentially displayed, or the third [-time] reflection pattem can be generated without inversion 
and reproduction for a region in which such a pattem with a lower number of reflections is present. 

[0058] 

Generation of the reflection patterns is repeated thereafter until the entire screen is covered 
by repeating exactly the same procedure in sequence. With this, a pattem like a kaleidoscopic 
image can be generated by merely repeating inversion and reproduction processing for the original 
image pattem. 

[0059] 

Figure 7 is a conceptual diagram showing pattem generation when the number of mirrors is 
four. In an actual kaleidoscope that has four mirrors, mirror boimdaries and their reflection 
patterns as indicated by the dotted lines and dot-dash lines in the figure are present However, even 
for regions where such boundary patterns are present, the equivalent kaleidoscope patterns can be 
generated by simply inverting and reproducing original image 0 in the same marmer as in the case 
of the three-surface kaleidoscope pattem described above. 

[0060] 

That is, also in the case of Figure 7, first reflection pattems (1) are generated by inverting 
and reproducmg the original image using the four sides enclosing original image 0 as the 
symmetry axes in the same way as the case in Figure 4. Next, second reflection pattems are 
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generated by inverting and reproducing reflection patterns 1 with each of the four sides enclosing 
them as a symmetry axis. In this case, when there is overlap with reflection patterns with fewer 
reflection times by inverting and reproducing, the procedure above is repeated preferentially . 
displaying the reflection pattems with fewer reflection times, or not performing inversion and 
reproduction for such regions. 

[0061] 

When the entire screen is covered with inverted and reproduced pattems generated as 
above, this will give a pattern corresponding to a kaleidoscopic image. 

[0062] 

Figure 8 is a flow chart showing the flow of kaleidoscopic image generation as explained 
above. Kaleidoscopic image-generation processing will be explained below referring to Figure 8. 

[0063] 

Fiirst, the image signal picked up by video camera (6) is input to kaleidoscopic 
image-generating device (8) (step S202). 

[0064] 

Next, the parameters for the shape of the image piece that will be the original image are 
input from the image signal (step S204). 

[0065] 

Next, extracting of the initial image piece is performed based on the shape of the image 
piece input (step S206). 

[0066] 

Next, the image piece is reproduced (step S208), and inversion and rotation of the pattem is 
then performed to produce the inverted shape with respect to the axis of symmetry (step S2 10). 

[0067] 

Next, it is determined whether or not the entire space is filled completely (step S212). 
When kaleidoscopic image-generating device (8) determines that the entire space is filled 
completely, the corresponding image signal is output to display device (10) (step S214). 
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[00681 

On the other hand, when kaleidoscopic image-generating device (8) determines that the 
space is not filled completely (step S212), processing is returned to step S208. 

[0069] 

Inversion and reproduction of the original image (initial image) is repeated as above until 
the entire screen is covered with reflection patterns. 

[0070] 

hi the case explained above, because of starting with an equilateral triangle-shaped or 
square-shaped original image, the two-dimensional space can be covered with it with no overlap. 
However, the shapes with which a two-dimensional space can be covered are not limited to these, 
and other shapes, for example, a rectangular shape, or the like are possible. 

[0071] 

However, when the shape of the original image is a more common shape, there are 
instances when covering all of a two-dimensional space just by inversion and reproduction of the 
original image with no overlap is difficult. 

[0072] 

Figure 9 shows such a case. In Figure 9, a case where a common triangular shape is used as 
the original image is shown. In this case, when reflection patterns (1) in which original image 0 has 
been inverted and reproduced for each of its sides and patterns (2) with further inversion and 
reproduction are generated, individual pattems will overlap each other. 

[0073] 

Note that, in Figure 9, the dotted lines indicate the mirror boundaries. Therefore, in a case 
as described above, how to process the pattems in which such overlap occurs is a problem. 

[0074] 

Figure 10 shows a case where processing that is as faithftil as possible is performed with 
mathematical processing for reflection produced by an actual mirror. 

[0075] 

In Figure 10, the three principles below are used to calculate the pattems. 
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[0076] 

(1) Reflection patterns do not pass the mirror boundaries. . 

(2) Patterns with a larger number of reflection times do not cover patterns with a smaller 
number of reflection times. 

[0077] 

(3) Reflection patterns do not pass the reflection boundaries. 

However, when processmg such as this is performed, particularly in processing <3) above, 
reflection at mirror boundaries is calculated folly and processing corresponding to this must be 
performed, and the calculation is complicated. 

[0078] 

Therefore, in order to forther simpliiy pattems, the two methods below may be considered. 
That is, at the step for arrangement (step S208) using the rotation and inversion shown in Figure 8, 
a kaleidoscopic image can be generated even for ordinary original image shapes by using either of 
the two methods described below. 

[0079] 

An example of the first processing is shown in Figure 1 1 . In the processing in Figure 1 1, as 
a principle of processing, a method is used wherein reflection pattems with a lower number of 
reflection times are displayed as present on a higher layer than reflection pattems with a greater 
number of reflection times. 

[0080] 

That is, for example, in the computer graphics, the number corresponding to a pattern 
created by reflection is sequentially incremented each time an inversion operation is performed for 
each side and corresponds to a numerical value (hereafter called Z value) that represents the depth 
at which the pattern is rendered (drawn). By performing processing as above, when inversion and 
reproduction are performed for a pattern, and a pattern with a larger nimiber is present in the region 
where said pattern is generated, a procedure whereby said pattern with the smaller number is again 
written on top may be used. 

[0081] 

That is, processing is performed to actually render starting with pattems with a smaller Z 
value in sequence. So, overwriting processing is performed only when the Z value of a pattem that 



23 



has already been rendered is larger than the Z value of a pattern to be rendered after it. Such 
overwriting processing is performed for each pixel. 

[0082] 

Such processing is usually incorporated into hardware as a Z buffer algorithm in recent 
workstations that perform graphics processing, so that very fast processing can be performed. 

[0083] 

Processing in a case where pattern overlap occurs as described above is for patterns with 
difiTering Z patterns. 

[0084] 

When overlap occurs in patterns where the Z values are equal to each other, processing 
with a method as described below is possible. 

[0085] 

That is, an order of priority of overlap is determined dependent on the order in which the 
patterns are rendered. For example, for the order of rendering, the sides are sequenced 
counterclockwise (or clockwise. One or the other is determined is advance.) from the original 
pattern and the reflection pattems are generated for each side according to that order. 

[0086] 

Figure 12 is a conceptual diagram showing how reflection pattems are generated when 
such processing is performed up to the second reflection pattern. In Figure 12, to facilitate 
understanding of the explanation, a case where the reflection pattems do not overlap each other is 
shown. When overlap occurs in the pattems, the pattern to be written on top is determined 
according to the order of priority explained below. 

[0087] 

Figure 13 is a tree diagram showing a reflection pattern generation process. Referring to 
Figures 12 and 13, each side of the triangle-shaped original pattern is prioritized in the order of 
side (A), side (B) and side (C), counterclockwise. Here, each side (A)-(C) corresponds to a mirror 
(axis of symmetry with inversion). 
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[0088] 

Reflection pattern Al is generated by inverting original pattern 0 using side (A) as the axis 
of symmetry. Next, reflection patterns (Bl) and (CI) are generated in that order using sides (B) 
and (C), respectively, as the axes of symmetry. Each first reflection pattern is prioritized according 
to the degree of priority of the side serving as the axis of synmietry when it is generated! 

[0089] 

Therefore, generation of the second reflection patterns is performed in the order of 
reflection patterns Al, Bl and CI . Each side of reflection pattern Al is also prioritized 
counterclockwise. That is, reflection pattern AB2 for side (B) of reflection pattem A 1 has a higher 
level of priority than reflection pattem AC2. The same holds for the second reflection patterns for 
reflection patterns Bl and CI. In Figure 13, the order of priority determined in this way is 
represented by (I)-(IO). That is, prioritization in Figure 13 gives lateral priority to the tree search 
when a tree structure for tum-around (pattem inversion) processing is created for each side of the 
pattem. It is also, of course, possible to consider a vertical priority algorithm. 

[0090] 

On the other hand, as explained above, a method where, rather than overwriting when 
pattem overlap occurs, the average of the pixel values (luminance, hue, etc.) in each pixel of the 
two (or more) pattems is calculated in the case of pattems with the same Z value to overlay them, 
may also be considered. In this case, a kaleidoscopic image is generated regardless of the rendering 
order. 

[0091] 

As a second method, there is the method shown in Figure 14. With this method, only the 
boxmdaries of mirrors obtained from the initial arrangement are calculated and generated as mirror 
boundaries, and no operations are performed on their reflection boundaries. 

[0092] 

In such a scope/range, inverted and reproduced pattems are generated with the principle 
that passing the boundary of each mirror does not generate a pattern, and so a kaleidoscopic image 
that is closer to reality can be generated. 
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[0093] 

Embodiment 2 

Figure IS is a schematic block diagram showing the constitution of an electronic 
kaleidoscope device in Embodiment 2 of the present invention. 

[0094] 

The difference from the constitution of the electronic kaleidoscope device in Embodiment 
1 is that it is constituted by a graphics generating device (14) that generates graphic images 
according to external instructions, and kaleidoscopic image generation device.(12) generates a 
kaleidoscopic image after a partial image signal with the initial image piece extracted from the 
imaging signal received from video camera (6) and a graphic image output from computer 
graphics generating device (14) are synthesized. 

[0095] 

The same symbols are assigned to the same parts otherwise, and explanations will not be 
repeated. Figure 16 is a conceptual diagram that explains the operation of kaleidoscopic 
image-generating device (12) and computer graphics generating device (14) shown in Figure 15. 

[0096] 

Kaleidoscopic image-generating device (12) carries out processing to extract designated 
region (S), within the image signal given by video camera (6), as the initial image piece, just like 
the operation by kaleidoscopic image-generating device (8) in Embodiment 1. On the other hand, 
computer graphic generating device (14) stores the appropriate drawing program and generates 
computer graphics (G) in a region the equivalent of region (S). 

[0097] 

Synthesis of computer graphics (G) output from computer graphic generating device (14) 
and initial image piece (S) is carried out in kaleidoscopic image-generating device (12). Next, a 
kaleidoscopic image is generated following the same procediire as explained in Figure 3 with the 
synthesized image signal (S+G) as the initial image piece. 

[0098] 

Figure 17 is a flow chart that explains the operation of the electronic kaleidoscope device 
in Embodiment 2. The kaleidoscopic image generation operation will be explained below referring 
to Figure 17. 
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[0099] 

The image signal picked up by video camera (6) is input to kaleidoscopic image-generating 
device (12) (step S402). 

[0100] 

Next, kaleidoscopic image-generating device (12) receives parameters for the image piece 
shape corresponding to the initial image piece from outside (step S304). 

[0101] 

Next, kaleidoscopic image-generating device (12) extracts (cuts out) an image signal 
corresponding to the initial image piece from the imaging signial according to the input parameters 
of the image piece shape (step S306). 

[0102] 

On the other hand, computer graphics generating device (14) creates computer graphics 
according to a built-in drawing program according to the data given externally (step S308). 

[0103] 

Next, computer graphics generating device (14) extracts (cuts out) the corresponding 
region of the computer graphics corresponding to the initial image piece shape (step S3 10). 

[0104] 

Kaleidoscopic image-generating device ( 1 2) receives the initial image piece extracted from 
the imaging signal and the initial image piece of the cortiputer graphics oulput from computer 
graphics generating device (14) and generates an image in which the two are synthesized (step 
S312). 

[0105] 

Next, kaleidoscopic image-generating device (12) reproduces an image piece using the 
synthesized image as the initial image piece (step S3 14). 

[0106] 

It ftirther rotates or inverts according to the image piece shape to arrange a reflection 
pattern corresponding to the image piece (step S3 16). 
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[0107] 

Next, kaleidoscopic image-generating device (12) determines whether or not the screen 
space is completely filled (step S3 18). When it is completely filled, it outputs the corresponding 
image signal to display device (10) (step S320). 

[0108] 

On the other hand, when it is determined that the space is not completely filled (step S3 1 8), 
processing returns to step S3 14 where the image piece is reproduced. 

[0109] 

By synthesizing not only the image signal picked up by video camera (6) but the image 
signal generated by computer graphics generating device (14) as above, it is possible to generate 
kaleidoscopic images with more varied configurations. 

[0110] 

Note that a kaleidoscopic image can also be generated for more common initial image 
piece shapes by configuring to carry out the processing explained with Figure 1 1 or Figure 14 in 
the arrangement of reflection patterns by rotation and inversion at step S3 16 shown in Figure 17. 

[0111] 

Overall constitution of the performance environment 

Figure 18 schematically shows the overall constitution of the performance environment . . 
using this invented performance support system. In the constitution shown in Figure 18, 
performance by three performers - a lead instrumentalist, a backup (accompanying) performer, 
and a rhythm performer - is assumed. That is, in Figure 18, the performance environment includes 
1 MIDI (musical instrument digital interface) instrument (101) with no sound source as the lead 
instrument, 1 MIDI instrument (102) with a sound source for accompaniment, 1 sequencer (104) 
with a soxmd source as rhythm, and a workstation (103) for supporting the performance of MIDI 
instrument (101) with no sound source. In Figure 18, keyboards are shown as examples as MIDI 
instruments (101) and (102). The coiresponding pitch mformation is generated with information 
input by the performer fi-om the performance positions on the white and black keys of the 
keyboards (101) and (102). 



[0112] . 

As shown in Figure 1, performer (1) must move to the performance piece to generate a 
kaleidoscopic pattern on display device (10). For this purpose, a portable MIDI guitar is used as 
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the musical instrument for ease of movement. However, a portable keyboard with small keys can 
be used as the instrument, and a keyboard is used as instrument (2) to facilitate understanding of 
the correspondence between chords and pitch. The same holds in the explanation below. But if a 
guitar is used, the same discussion applies in the explanation where a keyboard is used by 
interpreting chord positions on a guitar, since the positions where guitar strings are plucked 
corresponds to the keys of a keyboard. 

[0113] 

MIDI sequencer (104) has the base line and drum pattern for the piece to be performed 
programmed in advance, and the performer will perform accordmg to the rhythm from sequencer 
(104). A dynamic clock from sequencer (104) is given to the MIDI instrument (hereafter called a 
keyboard) (101) through MIDI input (Mil) and the dynamic clock is transmitted to keyboard (102) 
from keyboard (101) through MIDI THRU-terminal (MTH). 

[0114] 

MIDI information that consists primarily of notes from keyboard (101) (performance input 
information based on performance position manipulation) is given to workstation (103) through 
MIDI OUT-terminal (MOl) from keyboard (101), and performance input information is provided 
by keyboard (102) from MIDI OUT terminal (M02). The performance input information from 
keyboard (102) is given to amp/speaker (106) in the form of an ordinary audio signal through 
LINE OUT-terminal (M02b). Keyboard (102) has a sound source, and the pitch information 
corresponding to the performance input information is amplified by amp/speaker (106) and 
generated as audible sound by manipulation of the white and black keys as the performance 
positions. 

[0115] 

The MIDI information from keyboard (101), the MIDI mformation from keyboard (102), 
and the dynamic clock from sequencer (104) are given to workstation (103) and the performance 
support system included in workstation (103) proceeds with processing synchronized with the 
clock from sequencer (104). 

[0116] 

The performance support system built into workstation (103) processes tiie performance 
input information from keyboard (101) and gives pitch information resulting from that processing 
to sound module (105). Sound module (105) converts the pitch information provided by 
workstation (103) through MIDI OUT terminal (M03) to audio information and gives it to 
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amp/speaker (106), The audio information from sequencer (104) and keyboard (102) is also given 
to amp/speaker (106). Therefore, audio information corresponding to the rhythm, the lead 
performance, and the backup performance are generated simultaneously from amp/speaker (106). 

[0117] 

Configuration of the performance support system 

Figure 19 schematically shows the module configuration of the performance support 
system built into workstation (3) [sic; (103)] shown in Figure 18. In Figure 19, the performance 
support system (120) analyzes the composition data stored in composition database (110) and 
supports the performance according to the analysis result. 

[0118] 

Composition database (110) contains stored composition data in which the chord 
progressions of the composition and the theme melody are described in a fixed format for each 
performance piece. The composition data corresponding to the composition to be performed are 
selected from the composition data stored in composition database (110) and given to performance 
support system (120). 

[0119] 

Performance support system (120) analyzes the composition data provided by composition 
database (110). It includes automatic analyzer (122) that determines the usable tone series (scale) 
for each chord, a pitch assignment part (124) that assigns usable pitches for each chord to keys on 
keyboard (101) as performance positions according to the analysis result from automatic analyzer 
(122) and converts the performance input information from keyboard (101) to the assigned pitch 
information and outputs it, and an interaction support part (126) that determines the scale that can 
be used for each chord according to scale selection commands from the performer and/or pitch 
information for the accompanist given through keyboard (102). 

[0120] 

Pitch assignment part (124) includes analysis result storage table (124a) where the usable 
tone series information for each chord is stored according to the analysis result given by automatic 
analyzer (122) and pitch conversion part (124b) that assigns the pitch included in the usable tone 
series stored in analysis result storage table (124a) to performance positions on keyboard (101). In 
Figure 19, the correspondence of pitch assignments to keys as the performance positions for an F 
chord is shown as an example. Pitch assignment to performance positions will be explained in 
detail below. 
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[0121] 

Interaction support part (126) includes a scale/tension correspondence information storage 
part (126a) that stores the usable tension for each scale in the form of a table, for example. When 
there are multiple usable scales for one chord, interaction support part (126) selects a tension note 
that will not clash with the tension note according to the pitch information from keyboard (102) 
when the accompanist uses a tension pitch and gives it to analysis result storage table (124a) of 
pitch assignment part ( 1 24). 

[0122] 

Interaction support part (126) also selects the corresponding scale when there are multiple 
scales according to a scale selection instruction from the lead performer who is playing keyboard 
(101) through a joystick, for example, and selects the corresponding scale from the usable scales 
stored in analysis result storage table (124). The subjective characteristics of the lead performer 
can be expressed for the lead performer's performance by this. Next, the constitution of each part 
will be explained. 

[0123] 

Automatic analyzer 

Figure 20 schematically shows the module configuration of automatic analyzer (122) 
shown in Figure 19. In Figure 20, automatic analyzer (122) includes chord progression analysis 
part (122a) into which the composition data chord information provided by composition database 
(1 10) is sequentially input before the composition is performed, and scale determination part 
(122c) that references rule table (122b) according to the chord transition mformation from chord 
progression analysis part (122a) and determines the usable scale in the corresponding chord 
information. Rules that follow the "Berklee method," widely known theoretical knowledge in jazz 
improvisation playing, for example, are stored in rule table (122b). Chord progression analysis 
part (122a) analyzes the context, such as whether the key is major or minor, according to how the 
chord progresses. Scale determination part (122c) references rule table (122b) based on the context 
information for the chord transition and determines a usable scale for the chord information. 

[0124] 

For example, in the example of chords Dm7/G7/CM7 here, consider the determination of 
the scale for a Dm? chord. In this case, the tonality is C major, the chord Dm? in this key is Ilm?. 
Therefore, the usable scale, that is, the tone series, for the Dm? chord is detemuned to be D-dorian. 
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If a Dm7 chord is used in the key of B-flat, the Dm7 chord is the Ill-flat 7 chord, so the scale that is 
usable with the Dm7 chord is determined to be D-phrygian. 

[0125] 

Therefore, for the scales determined by scale determination part (122c), the chord 
transition is analyzed and the usable tone series at each performance position is not limited to the 
chord tones included in the chord at that point in time. For example, in a Dm? chord, the chord 
tones are D/F/A/C, while in the case of a D-dorian scale, the tones D/E/F/G/A/B/C are present and 
tones other than chord tones are included. Because of this, the degree of freedom of performance 
with improvisation is expanded. The usable tone series is also determined according to the rules 
contained in rule table (122b), and pitches that are theoretically accurate can be used. 

[0126] 

Figure 21 shows actual analysis results by automatic; analyzer (122). In Figure 21, the 
chord progression and the usable scales for each chord in the opening eight measures of "Autumn 
Leaves," a jazz standard, are shown. The chords in the eight measures in Figure 21 are 
Cm7/F7/B-flat M7/E-flat M7/Am7-flat5/D7/Gm7/G7. Scales that usable according to Berklee 
method as described above are determined for each of the chords. In the scale determination shown 
in Figure 21, chords for which there are multiple choices for one chord are limited to the domiiumt 
seventh. The dominant seventh chords, in Figure 21, are the F7, D7 and G7 chords. 

[0127] 

The F7 chord is a major key as to how the preceding and following chords change, and six 
usable scales are given. The six scales are "mixolydian," "lydian seventh," "whole tone," 
combination diminished," altered," and "hmp [harmonic minor perfect] fifth down." On the other 
hand, for the D7 and G7 chords in the sixth and eighth measures, the key is minor, so five scales, 
excludmg the "mixolydian" scale, are given. Only one scale is determined for the remaining major 
seventh and minor seventh chords. When multiple scales are given as choices, one scale is selected 
according to predetermined rules or the performer's instructions. This scale selection will be 
explained below. 

[0128] 

Performance using theoretically accurate pitches is always possible even during 
improvisation without any theoretical knowledge by analyzing the chord progressions, analyzing 
the chord time series transitions, and referencing a rule table to determine usable scales as shown 
in Figure 21. 
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[0129] 

Pitch assignment part module constitution 

Figure 22 is a block diagram schematically showing the module constitution of pitch 
assignment part (124) shown in Figure 19. In Figure 22, pitch assignment part (124) includes 
analysis result storage part (1 34a) that links the analysis results from automatic analyzer (1 22) 
with information for chords and the corresponding scale information and stores them, scale to be 
used selection part (134b) that selects a scale for each chord stored in analysis resuh storage part 
(134a) to correspond with chord progressions according to predetermined rules (when there are 
multiple scales for one chord), position/pitch correlation part (134c) that correlates the pitches 
included in the scales to be used selected by scale to be used selection part (134b) to all the keys of 
keyboard (101) according to predetermined rules, and pitch information generation part (134d) 
into which pitch information from keyboard (101) shown in Figure 18 is input and that converts 
the mput pitch information according to correlations by position/pitch correspondence part (134c) 
to generate pitch information. Analysis result storage part (134a) corresponds to ianalysis resuh 
storage part (124a) shown in Figxire 19 and position/pitch correlation part (134c) corresponds to 
performance position/pitch correlation part (124b) shown in Figure 19. 

[0130] 

Scale to be used selection part (134b) detects the end of each measure according to the 
timing signal from MIDI sequencer (104) shown in Figure 18 to motiitor chord progressions and 
selects chords and corresponding scales at each point in the performance. The constitution for 
selecting one scale by scale to be used selection part (134b) when there are multiple scales for one 
chord will be explained in detail later. 

[0131] 

Position/pitch correlation part (134c) correlates performance positions (keys) and pitches 
for each key on keyboard (101) so that pitches that have the same function in each chord will be 
assigned to the same key. The reason for assigning pitches that have the same function to the same 
keys with position/pitch correlation part (134c) will be explained below. 

[0132] 

First the term "function" will be explained. For example, in the case of a D-dorian scale, the 
note D has the "function" of the root tone in the D-dorian scale. Thereafter, E has the "function" of 
the second, F the third, G the fourth, A the fifth, B the sixth, and C the seventh in the D-dorian 
scale. For example, the third and seventh tones (the notes F and C in the D-dorian scale) are notes 
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that determine the "color" of the chord and have a musical fiinctidn. Here, chcM-d "color" indicates 
the chord environment, such as whether it is minor or major, or a dominant seventh or major 
seventh. Note that in the case of a D-ionian scale, the third is F-sharp and the seventh is C-sharp. 
Therefore, strictly speaking, the interval between notes D and F is a minor third interval, and the 
interval between D and C is a minor seventh interval. In contrast, the interval between the notes D 
and F-sharp is a major third interval, and the interval between the notes D and C-sharp is a major 
seventh interval. Therefore, even with the same third and seventh, the actual note interval varies 
for each scale. However, in each case, the notes at the positions of the third and seventh have the 
role of determining the chord (whether Dm7 or DM7). In this way, the expressions "third (III)," 
and "seventh" are used to mean expressing the "function" in each scale. Naturally, the second, 
fourth, sixth, and so on also have their respective musical functions. 

[0133] 

Position/correlation part (34c) [sic; (134c)] shown in Figure 22 assigns the pitches that 
have the same functions in each scale to the same positions for each key (performance position) on 
keyboard (1) [sic; (101)]. For example, as shown in Figure 23(A), in the case of a.C-dorian scale, 
the tone series included is C/D/E-flat/F/G/A/B-flat. And as shown in Figure 23(B), the tone series 
included in the case of an F-altered scale is 

[0134] 

(Formula No. 1) 

F/G-flat/A-flat/A-natural/B/D-flat/E-flat 

[0135] 

This type of scale is rarely used except with jazz or fusion, and it is generally little known. 
Therefore, for a jazz novice to suddenly be given only the tone series included in such a scale and 
asked to improvise would actually be very difficult. When a performance is done at a fast tempo, it 
will also be difficult to follow changes in the tone series. 

[0136] 

So, tones are reassigned to keyboard (101) according to the usable scale using 
position/pitch correlation part ( 1 34c). 



[0137] 

Figure 24 shows correspondences between all the keys of keyboard (101) and the tone 
series included in each scale in position/pitch correlation part (134c) shown iii Figure 22. As 
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shown in Figure 24, in position/pitch correlation part (34C) [sic; (134c)], the root note, second, 
third, fourth, fifth, sixth, seventh, and so forth are assigned to the corresponding white keys (Ka), 
(Kb), (Kc), (Kd), (Ke), (Kf), (Kg), and so forth, respectively, on keyboard (101). That is, notes that 
have the same function are nearly always assigned to white keys^ For the black keys, the note a 
half-tone lower than the note assigned to the white key munediately to the right of each black key 
is assigned. For example, in Figure 24, for black key (Kaa)^ the note a half-tone lower than the 
second assigned to white key (Kb) is assigned. In position/pitch correlation part (134c), 
correlations are performed in realtime simultaneously with chord changes according to each chord 
progression during a performance. 

[0138] 

By correlating the keyboard keys and notes as shown in Figure 24, at any point in the 
performance, the notes included in the usable scale are played for the chord at that time by the 
performer merely playing "do re mi fa so la ti do" with white keys (Ka)-(Kg) on keyboard (101). 
Therefore, the function in each scale assigned to each key is fixed, so the performer will not have 
to presume the scale to be played during the performance and can play always using the 
theoretically correct notes basically by usmg only the white keys. 

[0139] 

In the "Berklee method" used to determine scales in this embodimeiit, notes called "avoid 
notes" are designated. An avoid note indicates a note that one should avoid using as much as 
possible (at least, the note should not be held long), whether or not it is included in a scale. The 
reason this note is avoided is because the note has a tendency to interfere with the chord function 
(dominant, etc.) at that point in time. Such avoid notes often appear in the fourth position in a scale. 
Conversely, particularly the notes of the chord tones that have the function of the third and the 
seventh are notes that emphasize the chord function at that point in time, and produce what is 
called "chord color." A feel of chord progression in a composition can be produced by 
emphasizing these notes. On the other hand, the first tone (root tone) is too simple, ev^n in the 
same chord tone, and when used too much, jazz-like complexity is weakened. Jazz-like 
complexity can be obtained by using tension notes - the ninth, the eleventh, and the thirteenth. In 
this way, each note in a scale has an independent function, and which note at which position in one 
scale has what type of function is determined in advance. 

[0140] 

Therefore, by notes that have the same function in each scale being assigned to the same 
keys on keyboard (101) for each chord, as shown in Figure 24, the function assigned to each key of 
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the keyboard can be kept constant, even though the chords change, and performing can be 
accomplished easily. That is, the tone series of a scale at each point in time is assigned to keys 
(Ka)-(Kg) for "do re mi fa so la ti do" on keyboard (101). Therefore, the chord tones (first, third, 
fifth and seventh tones) at that point in time are assigned to keys (Ka), (Kc), (Ke) and (Kg) for do, 
mi, so and ti. Therefore, w^hen key (Kd) for fa to which the fourth is assigned is used, a phrase that 
has chord color can easily be produced by constructing the phrase while being careful not to 
produce a very long note and having key (Kc) for "mi" or key (Kg) for "ti" as the final target 

[0141] 

In jazz, the note a half-tone lower than the note in a scale is sometimes used as an 
embellishment note. Since the black key notes are assigned to be a half-tone lower than the notes 
of the white keys immediately to the right, embellishment notes can be generated easily. 

[0142] 

By correlating with position/pitch correlation part (134c) as above so that notes that have 
the same function are assigned to the sanie keys for each key on keyboard (101), the performance 
can easily produce phrases during improvisation; 

[0143] 

Pitch information generation part (134d) shown in Figure 22 receives input of pitch 
information (key manipulation information) from keyboard (101) based on the correspondence 
between keys and notes correlated by position/pitch correlation part (134c) and converts the pitch 
information input from keyboard (101) to the corresponding notes of the chord at that time and 
generates pitch information. For example, if the pitch information from keyboard (1) (sic; (101)] 
indicates the manipulation of white key (Ka), pitch information generation part (134d) generates 
pitch information indicating the root tone of the scale at that time. The pitch information from 
• pitch information generation part (134d) is given to the sound module shown in Fijgure 18. 

[0144] 

Note that parts where the chord changes, that is, the ends of measures, have been explained 
as being performed according to the timing clock from a sequencer in the pitch assigimient part. In 
this case, [the device] could also be constituted so that the end of each measiu-e is detected based 
on melody information included in the composition data and a rhythm generation reference from 
the sequencer so that chord changes, that is, scale changes, are carried out according to detection of 
the ends of measures. There are also cases where multiple chords are used in one measure. To 
handle such cases, information indicating how many beats a certain chord continues is included in 
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the composition data. Chord changes can easily be detected with this information and the clock 
signal from the sequencer. 

[0145] 

Variant example of automatic analyzer 

Figure 25 shows the constitution of a variant example of analyzer (122), The constitution 
of the major parts of chord progression analysis part (122a) included in analyzer (122) is shown in 
Figure 25. In Figure 25, chord progression analysis part (122a) includes chord change detection 
part (132a) that receives chord information and detects the size of the change and the change 
direction of the root tone pitch (or interval) in the chords arranged in a time series, and chord 
replacement part (132b) that searches a chord table (132c) using the chord information as 
reference data according to the information from chord change detection part (132a) indicating 
that the change is large, finds the corresponding chord information, and replaces the original chord 
information with the cord information after the search. The time series chord information 
transition in chord progression analysis part (122a) shown in Figure 20 is analyzed according to 
the chord information replaced by chord replacement part (132b) and the scale corresponding to 
the chord after replacement is determined. 

[0146] 

As shown in Figure 24, notes that have a predetermined fiinction in the scale are assigned 
to each of the keys on keyboard (101). In this case, consider when the pitch makes a laige jump 
when the scale changes. For example, when the chord changes Dm7 -> G7 CM7, when key 
(Ka) for do shown in Figure 24 is pressed, the note actually output changes D G -> C. When this 
note change is intended according to the progress of the composition or when a phrase in which 
pitch movement up or down is relatively drastic is played, the jump in pitch at the change will not 
produce much of a sense that it is wrong. However, when such a jump in pitch occurs when a 
phrase is played where the notes rise or fall monotonously, this feels wrong. This feeling of 
wrongness is felt particularly strongly when the pitch becomes lower while the pitch is rising or 
conversely, when the pitch becomes higher while the notes are falling. 

[0147] 

Chord change detection part (1 32a) detects scale changes that will cause such.a sense of 
wrongness. Chord replacement part (132b) references chord table (132c) when a jump in pitch that 
will cause such a sense of wrongness occure and replaces it with a chord that will decrease the 
sense of wrongness. For example, in the case of a chord progression as described above, the chord 
progression IIm7 V7 -> IM7 in C major appears very often in jazz, but a large jump in pitch 
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occurs before and after the V7 chord. So, the fact that a jump in pitch will occur is detected by 
change detection part (132a), and the scale is moved and assigned to key (Ka) for do shown in 
Figure 24 so that the note Il-flat in C major will be produced by change detection part (132b). With 
the V7 chord and the Il-flat 7 chord, the combinations of the third and the seventh that will produce 
. chord color are the same, and they can be used as substitute chords. This type of replaceable chord 
is stored in the form of a table in chord table (132c). That is, the chord progression in a C major 
scale is replaced by the chords IIm7 -> Il-flat 7 IM7. The result is that the notes of key (Ka) for 
do shown in Figure 24 only fail by half-tones II Il-flat -> I (D -> D-flat ^ C) and a large jump 
in pitch does not occur. 

[0148] 

The theoretically correct scale can be selected for each chord by analyzing the chord 
progressions after chord replacement. 

[0149] 

Figure 26 is a flow chart showing the operation of chord change detection part ( 1 32a) and 
chord replacement part (132b) shown in Figure 25. The chord replacement operation will be 
explained below referring to Figures 25 and 26. 

[0150] 

First, chord information adjacent to the subject chord is also given to chord change 
detection part (132a), and the distance between the root tones of the subject chord and the adjacent 
chord is measured (step S501). A judgment is made as to whether or not the code for the measured 
distance between the previous chord and the subject chord and the measured distance between the 
subject chord and the chord after it are the same (step S502). When the codes for the two measured 
distances are the same, the pitch has changed in the same direction, it is not necessary to replace 
the chord, and the subject chord at step S503 is selected. 

[0151] 

On the other hand, when the codes for the distances between the preceding and following 
chords and the subject chord are different, there is the possibility that a jump in pitch has occurred. 
So a judgment is made as to whether or not information for both of the two measured distances is 
greater than a predetermined threshold value (step S504). When at least one of the distances is 
smaller than the threshold value, it is judged that a jump will not occur in the pitch, {processing] 
returns to step S503 and the subject code is selected. 
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[0152] 

With a judgment at step S504 that both of the two measured distances are larger than tiie 
threshold value, the chord table is searched with the subject chord and a code indicating the 
direction of change of the subject chord as reference data from the chord table (step S505). 
Concerning the code, a code indicating a direction of change to approach the following chord is 
selected. Multiple candidate chords are retrieved by the chord table search. Here, in chord table 
(132c), multiple candidate chords are stored in the form of a table for the subject chord and code. 
This is shnply because the type of chords which are adjacent chords varies according to how the 
chords progress, so to deal with all of them, the scale of chord table (132c) will become large. 

[0153] 

Next, the chord that will give the smallest distance is detected from the chords on both 
sides from the multiple candidate chords retrieved (step S506). At step S506, a chord with a 
smaller jump than the original chord is used as a substitute chord. When there is a plurality, the 
substitute chord is determined taking the code and distance into account. For example, the 
processing below is carried out. The distances between the root tones of each of the multiple 
candidate chords and the root tones of the chords on both sides are measured. When a chord is 
selected in which the directions of distance change are the same and the distances are both smaller 
than the threshold distance, that chord is selected as the replacement substitute chord. When there 
is a plurality of such chords, the candidate chord with the smallest difference in distance for the 
chords on both sides is selected as the substitute chord. 

[0154] 

Next, the selected subject code or the detected substitute chord is output as chord 
information (step S507). For the code information output at step S507, the time series progression 
situation of the chord is next analyzed by the chord progression analysis part. 

[0155] 

Next, processing is ended when it has been performed for all chords. When xmprocessed 
chords still remain, [processing] returns to step S501 (step S508). 

[0156] 

The possibility that a jump in pitch will occur is judged by measxiring the distances 
between the root tones of the chords before and after the subject chord and comparing to codes for 
the distances as described above. Next, a chord progression with no jump in pitch can be realized 
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by detecting a chord that will (if possible) give the minimum distance to the chords on both sides 
and will give a distance that changes in the same direction. .... 

[0157] 

Note that chord replacement could also be executed in realtime in pitch assignment part 
(124) rather than being performed by automatic analyzer (122). That is, processing like the 
processing shown in Figure 26 is applied for each chord series in pitch assignment part (124). 
When a substitute chord is used for the subject chord, each tone of the scale assigned to the subject 
chord is shifted the same distance in the same direction as the distance between the root tone of the 
subject chord and the root tone of the substitute chord and the pitches after shifting are assigned to 
the keys of key board (101). In this case, because the chord progression is updated so that a jump in 
pitch is not produced, even when a scale is given according to theory, the scale is moved in a 
direction such that a jump in pitch will not be produced, so no problems in particular occur. 

[0158] 

Constitution of interaction support part 

Figure 27 schematically shows the constitution of interaction support part (126). In Figure 
27, interaction support part (126) includes tension distinguishing part (140) that receives pitch 
information provided by the accompanying performer through keyboard (102) and distinguishes 
whether or not the accompaniment pitch information includes any tension notes during the current 
performance according to the chord information stored in performance chord storage part (141), 
scale identification part (142) that references tension/scale table (143) according to tension notes 
distinguished by tension distinguishing part (140) and identifies the usable tone series, that is, the 
scale, and scale selection part (144) that selects the scale to be used fix>m the usable scales stored in 
usable scale storage part (145) according to the usable scale information identified jby scale 
identification part (142) and gives the information for the selected scale to be used to the pitch 
assignment part. Components (144) and 145) indicated by the broken line block in Figure 27 
correspond to the scale to be used selection part shown in Figure 22. The usable scales for the 
chords during the current performance are read from the analysis result storage part shown in 
Figure 22 and stored in usable scale storage part (145). 

{0159] 

Tension distinguishing part (140) identifies the root tone according to the performance 
chord information stored in performance chord storage part (141), identifies the fiinction of the 
pitch information provided by the accompanying performer using that root tone as reference, and 
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identifies whether or not the pitch played by the accompanying performer is a tension note and 
which note it is if it is a tension note. 

[0160] 

The correspondence between scale and usable teiisiori notes for each scale as shown in 
Figure 28 is stored in tension/scale table (143). In Figure 28, notes indicated by O are tension notes 
that are usable in the corresponding scales. Usually, there are six tension notes used in jazz - the 
sharp [sic; flat] ninth (ninth), ninth, sharp ninth, sharp eleventh, flat thirteenth, and thirteenth. 

[0161] 

Scale identification part (142) searches tension/scale table (143) using a tension note 
(represented by function) distinguished by tension note distinguishing part (140) and identifies 
usable scales. For example, when tension distinguishing part (140) distinguishes that the 
accompanist uses the flat ninth and flat thirteenth tension notes, scale identification part (142) 
selects the altered and hmp (harmonic minor perfect) fifth down, that include both tension notes as 
usable tension notes. When two scales are selected as usable scales, one of these scales is selected 
(this rule will be explained later). 

[0162] 

Scale selection part (144) selects the scale to be used from usable scale storage part (145) 
according to the usable scale information provided by scale identification part (142) and gives it to 
the pitch assignment part. Root tone information is included in the information for the scale to be 
used provided by scale selection part (144) to the pitch assignment part. 

[0163] 

In a jazz performance, which tension note to use in a given chord is basically left to up to 
the performer, and the degree of fi-eedom is very high. Therefore, when there are multiple 
performers, there are cases where tension clashes occur. For example, when one performer uses 
the ninth tension note and another performer uses a flat ninth tension note, the overlap of tones in 
such a minor second interval will give an extremely inharmonious effect, so normally it should be 
avoided. By using the constitution shown m Figure 27, which tension note is being used by the 
accompanying performer is detected, a scale that has tension notes that will not clash with that 
tension note can be used, and the occurrence of impleasant dissonance caused by clashes in tension 
can be prevented. 
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[0164] 

The scale selection operation is executed in realtime at each point during the performance 
according to the performance pitch of the accompanying performer. Therefore, the scale is 
sometimes updated multiple times in one chord performMce period (or 1 nieasure period). 

[0165] 

Variant example 

Figure 29 shows the constitution of a variant example of the dissonance occurrence 
prevention part. In Figure 29, interaction support part (126) includes pitch/tension conversion part 
(150) that converts the backup pitch information provided by the accompanying performer 
through keyboard (102) to performance position information based on root tone information for 
the chord currently being played stored in current root tone information storage part (151), note 
clash judgment part (152) that receives the performance position information provided by 
keyboard (101) and the performance position information provided by pitch/position conversion 
part (150) to judge whether or note a note clash is occurring, usable scale identification part (154) 
that is activated by note clash detection by note clash judgment part (152) using the performance 
. position information from pitch/position conversion part (150) as reference data and that identifies 
a usable scale, and scale to be used deteimination part (156) that determines a scale to be used from 
the usable scales stored in usable scale storage part (145) according to the usable scale information 
from usable scale identification part (154) and that provides the information for the scale to be 
used to the pitch assignment part. 

[0166] 

Pitch/position conversion part (150) measures the distance between the current root tone 
stored in current root tone information storage part (151) and the backup pitch information and 
converts the backup tone to performance position information, that is, function information. Note 
clash judgment part (152) judges whether or not the distance between the performance position 
information and the performance pitch information from pitch/position conversion part (150) is a 
prescribed condition (for example, a minor second interval), and judges that a note clash is 
occurring when the rule is violated. When the performance position information and the backup 
pitch information are each given in the form of a chord, judgment of note clashes is based on the 
measurement of the distances for each performance position. 

[0167] 

Usable scale identification part (154) searches for a scale that will not produce dissonance 
with the backup pitch information as a usable scale using the performzmce position information 
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from pitch/position conversion part (150) as reference data only when note clash judgment part 
(1 52) judges that a note clash is occurring. Scale to be used determination part (156) references the 
usable scales stored in usable scale storage part (145) according to the usable scale mformation 
(root tone information is not included, only which scale is used is indicated) from usable scale 
identification part (154) and determines the correspondmg scale as the scale to be used. Root tone 
information is included in the information for the scale to be used from scale to be used 
determination part (156). 

[0168] 

In the case of the constitution shown in Figure 29, the scale is converted only when a clash 
in the notes for the pitch played by the accompanying performer and the pitch played by the lead 
performer playing keyboard (101) occurs. When a note clash does not occur, scale to be used 
determination part (156) uses a scale stored in usable scale storage part (145) according to 
predetermined rules. 

[0169] 

Constitution of sensitivity tone series selection part 

Figure 30 schematically shows the constitution of the sensitivity tone series selection part. 
The sensitivity tone series selection part selects scales to be used according to sensitivity 
information provided by sensitivity information input interface (160). The sensitivity tone series 
selection part is included in interaction support part (26). 

[0170] 

The sensitivity tone series selection part includes sensitivity judgment part (1 62) that 
judges the sensitivity designated according to the sensitivity information provided by sensitivity 
information input interface (160), sensitivity information database (161) that stores predetermined 
sensitivity information for each scale, and candidate scale determination part (164) that references 
sensitivity information database (161) according to the sensitivity information from sensitivity 
judgment part (162), searches for scales corresponding to the designated sensitivity and 
determines candidate scales to be used. Candidate scale determination part (164) determines the 
designated candidate scale with the scale information currently being used stored in current scale 
information storage part (163) as reference when the sensitivity mformation from sensitivity 
judgment part (162) indicates information for relative sensitivity, "lighter," for example, for the 
current scale. Therefore, when sensitivity information, for example, "lighter," is given, a scale that 
will give a lighter sensitivity than the sensitivity that indicates "lightness" assigned to the current 
scale is determined as a candidate scale. In this case, when the sensitivity judged by sensitivity 
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judgment part (162) corresponds one to one for each scale, it is not necessary to provide the current 
scale information storage part ( 1 63). 

[0171] 

The sensitivity tone series selection part further includes scale to be used determination 
part (166) that selects a scale corresponding to the candidate scale from the usable scales for the 
current chord stored in usable scale storage part (165) according to the candidate scale information 
from candidate scale determination part (164) and gives it to the pitch assignment part as. 
information for the scale to be used. Scale to be used determmation part (166) selects a scale that is 
closer to the designated sensitivity and generates information for the scale to be used when a scale 
determined by candidate scale determination part (164) is not present in usable scale storage part 
(165). 

[0172] 

Figure 31 shows one example of the constitution of the database stored in sensitivity 
information database (161). In Figure 3 1, sensitivity information (Sa), (Sb), (Sc), (Sd), Se) and 
(Sf) are given for the six scales "mixolydian," "lydian seventh," "whole tone," "combination 
diminished," "altered," and "hmp (harmonic minor perfect) fifth down," respectively. 

[0173] 

In Figure 31, information on an axis corresponding to lightness and darkness of the 
impression for "light impression" and "dark impression" is shown as an example. Overall, the 
mixolydian and Lydian seventh scales give a light impression, the altered and hmp fifth down 
scales give a dark impression, and the whole tone and combination diminished scales give an 
intermediate (colorless) impression. Sensitivity information indicating the impression degree for 
each scale is assigned as shown in Figure 3 1 in accordance with these general impressions. 

[0174] 

In the case of the axis information as shown in Figure 31, a joystick is used as sensitivity 
information input interface (60). The designated sensitivity is specified by the direction of change 
and the ratio of change by the joystick and the corresponding scale is designated. Scales may be 
selected with the joystick alternatively according to the direction of change and the size of the 
distance, or sensitivity information for "lighter" or "darker" may also be input by the joystick with 
the cuirent chord as reference simply according to the direction of change. 
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[0175] 

Different sensitivity information to give other impressions, such as "litheness" could also 
be used rather than using only sensitivity on an axis for lightness or darkness of the impression. 
When multiple types of sensitivity information are used, a candidate scale is determined for each 
[type of] sensitivity information. 

[0176] ' 

Figure 32 is a flow chart showing the operation of the sensitivity tone series selection part 
shown in Figure 30. The tone series (scale) selection operation according to the sensitivity 
information will be explained below referring to Figures 30 to 32. 

[0177] 

First, when a performance starts, sensitivity judgment part (162) judges whether sensitivity 
information has been input from sensitivity information input interface (160) (step S620). If no 
sensitivity information has been input from sensitivity information input interface (160), if there 
are multiple scales, one scale is selected according to prescribed rules (step S621). As prescribed 
rules, when the chord progression is a miajor progression, a mixolydian seventh scale is selected, 
and when the chord progression is a nunor progression, the hmp fifth down scale is selected. 
Whether the chord progression is major or minor is determined at the time of scale selection for 
each code by an automatic analyzer. When there are multiple scales, with a major progression, six 
scales are selected, and with a minor progression, five scales are selected. Therefore, if a flag 
indicating that the chord progression is major or minor is assigned to each chord during the scale 
determination operation by the automatic analyzer, one scale can be selected when there are 
multiple scales by looking at the minor/major indicating flag. When only one scale can be used, 
one scale is selected. 

[0178] 

Sensitivity judgment part (162) judges the designated sensitivity when it judges that 
sensitivity information has been input from sensitivity information input interface (160) (Step 
S622). For designation of sensitivity, sensitivity is recognized according to joystick handling when 
sensitivity information input interface (160) is a joystick as described above, for example. When 
the sensitivity information from sensitivity information input interface (160) indicates relative 
sensitivity information (lighter or darker), candidate scale determination part (164) references 
sensitivity information database (161) using the current scale(s) stored in current ^cale information 
capability part (163) as a reference and determines the scale corresponding to the designated 
sensitivity information (step S623). In this case, when the sensitivity information from sensitivity 
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information input interface (160) designates sensitivity alternatively (the lightest, for example), 
candidate scale determination part (164) searches sensitivity information database (161) without 
referencing current scale information storage part (163) and selects the scale corresponding to the 
designated sensitivity. 

[0179] 

When scale to be used determination part (166) receives candidate scale information from 
candidate scale determination part (164), it searches for the corresponding scale from the usable 
scales for the current chord (step S624). When a corresponding scale exists among the usable 
scales stored in usable scale storage part (165), the corresponding scale is selected (Step S625). On 
the other hand, when the sensitivity information "lighter" is input when a mixolydian scale is the 
scale currently in use, there is no corresponding scale. In such a case and in cases where there is 
only one usable scale, the scale closest to the candidate scale (one scale when there is only one) is 
selected (Step S626). Assuming that the scale selected by scale to be used determination part (166) 
is the scale that will be used when the corresponding chord is played, it is given to the pitch 
assignment part (step 5627). Thereafter, the processing operation is repeatedly executed imtil the 
performance is completed. 

[0180] 

Note that as sensitivity information input interface (160), a dedicated information input 
board, such as a numerical keypad, could also be used in place of a joystick as described above. 
Various information, such as how the performer manipulates the performance input interface, the 
performer's posture and/or expression, or the like could also be used as sensitivity information for 
scale selection. 

[0181] 

By selecting scales according to sensitivity information as described above, the unage the 
performer wants to express can be expressed. 

[0182] 

Anotiier constitution for the interaction support part 

Figure 33 schematically shows the constitution of an interaction support part that is 
provided with a tension clash prevention and sensitivity tone series processing function for a 
musical instrument with a performance support function according to the present invention. The 
constitution shown in Figure 33 corresponds to a combination of the constitution of the sensitivity 
tone series processing part shown in Figure 30 and the constitution of the tension clash prevention 



46 



processing part shown in Figure 29. The same reference numbers are assigned to the 
corresponding parts of the components shown in those figures and the components shown in 
Figure 33. 

[0183] 

In Figure 33, the tension clash prevention processing part includes pitch/position 
conversion part (150) that receives backup pitch information from the accompanying performer 
and converts it to information indicating the backup pitch performance position (function) using 
the root tone stored in current root tone information storage part (151) as reference, note clash 
judgment part (152) that receives a performance position from the performer and performance 
position information from pitch/position conversion part (150) and judges whether or not a pitch 
clash is occurring by judging the distance between those positions, and usable scale identification 
part (154) that searches tension/scale table (143) using the performance position information from 
pitch/position conversion part (150) as reference data to detect a usable scale. The constitution of 
these parts is the same as the constitution shown in Figure 29. 

[0184] 

The tension clash prevention processing part further includes a scale update part (1 70) that 
accesses usable scale storage part (173) in which usable scale information is stored for the current 
chord according to the usable scale information from usable scale identification part (154) and 
deletes scales other than the usable scale. Scale update part (170) does not access usable scale 
storage part (173) if usable scale information is not provided by usable scale identification part 
(154), that is, if a tension clash will not occur. Therefore, the scale information stored in usable 
scale storage part (173) is only rewritten when a tension note clash occurs (which differs from 
chord conversion). 

[0185] 

The sensitivity tone series processing part includes sensitivity determination part (162) that 
receives sensitivity information provided by sensitivity information input interface (60) to 
determine the designated sensitivity, candidate scale determination part (164) that searches 
sensitivity information database (161) according to the designated sensitivity information from 
sensitivity determination part (162), reads the current scale information from current scale 
information storage part (163) and determines a candidate scale usmg the current scale as 
reference, and scale to be used determination part (175) that accesses usable scale storage part 
(173) according to the candidate scale information from candidate scale determination part (164) 
and detects the corresponding scale. Scale to be used determination part (175) operates like the 
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flow chart shown in Figure 32. With this, when a scale corresponding to a candidate scale from' 
candidate scale determination part (164) is stored in usable scale storage part (173), the scale that 
is closest to the candidate scale is selected and given to the pitch assignment part. On the other 
hand, when sensitivity information is not provided by sensitivity information input interface (1 60), 
candidate scale determination part (164) does not operate and information is not given to scale to 
be used determination means (175). In this situation, scale to be used determination means (175) 
selects one scale from iisable scale storage part (173) according to whether the current chord 
progression is minor or major. If the chord progression is a major progression, a Lydian seventh 
scale is selected, and if the chord progression is a minor progression, a hmp fifth down scale is 
selected. If the scales in usable scale storage part (173) have been updated by scale update part 
(170) and if there is no corresponding scale, scale to be used determination part (175) selects the 
scale that is closest to the scale determined according to the chord progressioHni. 

[0186] 

By using the constitution shown in Figure 33, performance can be realized according to the 
performers' sensitivity while avoiding note clashes between the performers. 

[0187] 

Variant example of performance input interface 

Figure 34 schematically shows the constitution of a variant example of the performance 
input interface according to the present invention. In Figure 34, the performance input interface is 
provided with multiple regions (179a)-(179) [sic; (179g)] that the performer can designate. A 
performance position are assigned to each of the regions (179a)-(179g), and a root tone, second, 
third, fourth, fifth, sixth and seventh tone is assigned to each of the regions. When the performer 
specifies a region ( 1 79a)-( 1 79g), information indicating a performance position, that is, 
performance position information corresponding to the tone function, is generated according to the 
designated region. The regions (179a)-(179g) could be spatial regions or they could be two 
dimensional regions on a display screen. That is, the performance input interface is not limited to a 
guitar or keyboard but could also be something fliat generates MIDI signals as well as specifying 
performance positions. 

[0188] 

A performance input interface that has the performance positions shown in Figiire 34 
realizes the effects below. The previously shown F-altered chord in Figure 23(B) includes chord 
tones as below. 
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[0189] 
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[0190] 

Therefore, for keyboard instruments, such as a regular keyboard, "sharp IX" rather than the 
function "III" is assigned to the key "mi," and the function "III" is assigned to the "fa" key. 
Therefore, with an F-altered chord, the. characteristic of a "fixed assignment for each key" function 
is not lost. However, if a constitution as shown in Figure 34 is used, strict functions by 
performance position for all chords can be realized, since the key arrangement is not affected. 

[0191] 

Figure 35 shows an actual constitution for a variant example of the performance input 
interface. In Figure 35, the performance input interface includes magnetic sensors (180a) and 
(1 80b) attached to the person's arm, a position detection means (1 82) that detects the position in a 
spatial region according to the position information from the magnetic sensors (180a) md (180b), 
and a performance position identification part (184) that converts the position information 
detected by position detection means (1 82) to position information and outputs it. With ttie 
magnetic sensors (1 80a) and (1 80b), both of the person's arms restrained is assigned to the position 
for the root tone, both arms bent 90^ is assigned to the performance position for the third, and both 
arms bent 180® with the forearm and upper arm touching is assigned to the performance position 
for the seventh. That is, position detection means (182) generates information indicating tiie 
position of the person's arms according to the position information detected by magnetic sensors 
(180a) and (18b) and performance position identification part (184) identifies the performance 
position according to the information indicating arm position from position detection means (1 82). 

[0192] 

Note that, in the constitution shown in Figure 35, magnetic sensors (180a) and (180b) are 
used, but a constitution in which only one magnetic sensor for measuring the position of the 
person's arms is used or in which the performance position is specified according to the position of 
one arm could also be used. 
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[0193] 

By measuring the position of a person's arms using a magnetic sensor, operation will be 
easy for the performer, who can freely "choreograph" the musical composition tfiat is performed, 
changes in the image displayed by the display device can be to correspond with the musical 
composition that is performed, and the musical composition and video that are produced can easily 
be made to harmonize. 

[0194] 

Also, when a wind instrument, such as a trumpet, is used, a combination of "valve 
combination + lip and air stream intensity at the mouthpiece" can be correlated to performance 
positions. When a trumpet is used as the performance input interface, the advantage below could 
conceivably be achieved. Namely, in the case of a trumpet, normally individual pitches are 
produced by the combination of three valves and the air stream intensity. Therefore, for a novice, 
there is no intuitive fingering where if the valves are "fingered this way, the note should continue 
to rise." Therefore, if an instrument such as this is used, the expectation of a continual rise or 
continual fall in pitch is slight, so even if a pitch jump occurs, the feeling of wrongness would seem 
to be small. Therefore, when an interface such as this is used, jumps in pitch are controlled, so it 
appears that processing for substitute chords is unnecessary. 

[0195] 

Even when a wind instrument, such as a trumpet, is used, the performer can move his entire 
body relatively freely. Therefore, the imaging signals can be changed to correspond with the 
musical composition that is performed, and video that is harmonious with the musical composition 
can be generated. 

[0196] 

In the abovementioned explanation, the usable scales for each chord are selected according 
to the "Berklee method" with the object of supporting jazz improvisation. In this case, multiple 
scales are usable only for the dominant seventh chord. However, [the device] could also be 
constituted so that multiple scales can be used for each chord in this case. A different theory could 
also be used for jazz improvisation. 

[0197] 

In addition, the constitution of the present invention can be applied not only to jazz 
improvisation but to compositions in other genres as well when usable tone series (not limited to 
scales) are predetermined when chords are given. 
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[0198] 

Variant Example 2 

In the abovementioned explanation, the performance support system determines usable 
tone series according to the chord transitions in performing musical compositions. However, when 
performance positions are mapped for the peripheral space aroimd the performer as shown in 
Figure 34, a constitution as below can be used. That is, by the performer virtually "striking" the 
performance positions using magnetic sensors (180a) and (180b) as shown in Figure 35, 
performance position information is input to the performance support system as though the 
performance positions were played. That is, it is the equivalent of a situation where an invisible 
virtual drum set exists in the space around the performer and striking of the virtual drum set will 
give a musical performance. Simultaneously with this, the operation of striking the virtual drum 
set is given to the kaleidoscopic image generation device through video camera (6) as gestures. 
Therefore, the musical composition and video that are produced will be harmonious even when 
this type of rhythmic music is produced and musical composition and video of a high standard can 
easily be produced, 

[0199] 

Embodiment 3 

Figure 36 schematically shows the overall constitution of an art-producing device 
according to Embodiment 3 of the present invention. In Figure 36, performance support system (4) 
includes performance position input interface (185) for inputting performance position 
information from performer (1) and performance position recognition part (190) that recognizes 
the performance positions input by the performer according to flie performance position 
infomiation provided by performance position input interface (185). Performance position input 
interface (185) includes performance positions (179a)-(179g) for specifying the pitch of the 
musical composition to be played and additionally performance positions (190a)-(190n) for 
inputting image embellishment information for embellishing the displayed image. 

[0200] 

Performance position recognition part (190) gives performance position information 
indicating the input performance positions to image embellishment device (200) furnished 
between kaleidoscopic image-generating device (8) and display device (10) when performance 
position information is input through performance positions (190a)-(190n). 
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[0201] 

Image embellishinent device (200) receives the input of image signals from kaleidoscopic 
image-generating device <8) and processes image embellishment for the input image signal 
according to the performance input position provided by performance position recognition part 
(190). Each performance position and the image embellishment processing to be performed are 
already correlated and stored by image embellishment device (200), and the corresponding image 
embellishment processing is performed according to the image embellishment processing 
information input. 

[0202] 

Figure 37 schematically shows the constitution of image embellishment device (200) and 
display device (10) shown in Figure 36. In Figure 37, image embellishment device (200) includes 
control part (200a) that controls the operations required for the designated image embellishment 
processing according to the performance position information provided by performance position 
recognition part (190), R processing part (200b) into which the R signal (red signal) of the image 
signal from kaleidoscopic image-generating device (8) is input and that performs the required 
processing imder the control of control part (200a), G processing part (200c) into which the G 
signal (green signal) of the image signal from kaleidoscopic image-generating device (8) is input 
and that performs the required processing under the control of control part (200a), and B 
processing part (200d) into which the B signal (blue signal) of the image signal from kaleidoscopic 
image-generating device (8) is input and that performs the required processing under the control of 
control part (200a). Control part (200a) could also be constituted so that the performance positions 
and the programs to perform image embellishment processing are correlated and stored with the 
programs executed corresponding to the designated performance positions. Also, in place of this, it 
could also be constituted to decode the performance position information and generate the required 
control signals according to the decoding result. 

[0203] 

Each of R processing part (200b), G processmg part (200c) and B processing part (200d) 
processes, e.g., adjusts the levels and the like, for the given R signal, G signal and B signal, 
respectively. The image signal from kaleidoscopic image-generating device (8) is a digital signal, 
and level adjustment is realized by shifting the positions of the image bits, for example. 

[0204] 

Display device (10) includes image display controller (10a) that receives the R signal, G 
signal and B signal provided by image embellishment device <200), raster scans them in a 
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prescribed order, and displays the image signal on display screen (10b). Image display controller 
(10a) is like the controller for an ordinary image display device. It converts the digital signal 
provided by image embellishment device (200) tp an analog signal, and performs the required 
display control according to whether display screen ( 1 Ob) is a CRT, a liquid crystal display or a 
simple screen on which video is projected to display the kaleidoscopic image signal on display 
screen ( 1 Ob). The operation will next be described briefly. 

[0205] 

Consider a case where performer (1) manipulates performance position (190a) through 
performance position information input interface (185). Performance position information input 
interface (1 85) is realized using magnetic sensors and a position detection device as shown in 
Figure 35 previously. Here, consider a case where performance position (190a) requires 
processing to emphasize the red color of the displayed video. In this case, image embellishment 
device (200) causes R processing part (200b) to increase the level of the R signal provided by . 
kaleidoscopic image-generating device (8) and increase the R signal amplitude, under the control 
of control part (200a). In this case, processing to decrease the levels of the G signal and B signal 
could also be performed by G processing part (200c) and B processing part (200d). Image display 
controller (10a) generates an image signal embellished with red emphasized by image 
embellishment device (200) and generates it on display screen (10b). With this, the video signal 
requested by performer (1) is easily generated on display screen (1 Ob). 

[0206] 

Image embellishment processing in addition includes "making the screen lighter/* "making 
the screen darker," "inverting color," etc. 

[0207] 

[The system] could also be constituted so that "making the screen lighter" and "making the 
screen darker" are produced interlocked with the sensitivity information input explained with the 
previous performance support system. The display video can-also be made correspondingly lighter 
when the musical composition played is made lighter, and video that is harmonious with respect to 
the musical composition that is played can be generated. 

[0208] 

In addition, the performance positions could also be constituted so that, in addition to 
image embeUishment, information that specifies further processing of the kaleidoscopic image 
will be generated. For example, during kaleidoscopic image generation, arrangements of multiple 
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mirrors, for example, where the number of mirrors is 2, 3, etc., is indicated. The generated 
kaleidoscopic pattern can be significantly changed to correspond with the played musical 
composition by correlating the mirror arrangement to performance positions and the video signal 
can easily be changed according to the played musical composition. In addition, the constitution 
could also be such that the size of the center angle of the partial imaging signal that is the unit of 
the kaleidoscopic image is correlated to performance positions! 

[0209] 

Note that displaying such as "making the screen lighter" and "making the screen darker" 
can easily be realized if the level of the brightness signal component Y is simply adjusted and the 
levels of the R signal, G signal and B signal are all adjusted to the same level. 

[0210] 

In addition, special video effects could also be correlated to the performance positions. 

[0211] 

Embodiment 4 

Figure 38 schematically shows the overall constitution of a multimedia art-producing 
device according to Embodiment 4 of the invention. In Figure 38, the mxiltimedia art-producing 
device according to Embodiment 4 of the present invention mcludes information input part (210) 
for multiple media for inputting media information for expressing art using media and control 
information representing the conditions for that expression, a knowledge base (215) where 
knowledge required for expressing art using a mediimi is stored for each of the media, an 
information processing part (220) that receives media information and control information, 
references media knowledge corresponding to the media information and control information from 
information input part (210) from knowledge base (215), and processes the rnedia information 
according to the referenced knowledge and the received control information, and information 
presentation part (230) that presents the information processed by information processing part 
(220) using the corresponding medium. 

10212] 

An information input part (210) is furnished for each medium. It includes media 
information input part for inputting media information (M#a)-(M#m) for expressing art in each 
medium, and control information input part (210b) for inputting control information (C#a)-(C#m) 
indicating the conditions for art usiiig each medium. Media information input part (210a) 
corresponds to video camera (6) in the kaleidoscopic image-generating device and corresponds to 
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a MIDI guitar or MIDI keyboard in the musical composition producing part. Control information 
input part (210b), in the kaleidoscopic image-generating device, corresponds to control parameters 
designating the number of mirrors for the kaleidoscopic image and the shape and size of the unit 
kaleidoscopic image. In the musical composition producing part, control information input part 
(2 1 Ob) corresponds to the sensitivity information input part and a pitch information generation part 
from the accompanist if there is an accompanist. 

[0213] 

Knowledge base (215) stores the knowledge required when art is produced using each of 
the media. It stores knowledge for realizing an algorithm for generating a kaleidoscopic image 
with each mirror arrangement in the kaleidoscopic image-generating device. In the musical 
composition producing part, knowledge base (2 1 5) corresponds to the automatic analyzer based on 
"Berklee method," 

[0214] 

Information processing part (220), in the kaleidoscopic image-generating device, 
corresponds to the part that generates the unit kaleidoscopic image to fill the screen from the video 
signal input from the video camera based on control parameters. In the musical composition 
producing part, the information processing part corresponds to the pitch assignment part. 
Information presentation part (230), in the kaleidoscopic image-generating device, corresponds to 
the display device, and in the niusical composition producing part, corresponds to the sound 
module and the amp/speaker. 

[021i5] 

When the art produced uses other tiian soimd and video, for example, when a picture is 
produced on the screen, the knowledge for producing that picture is stored in knowledge base 
(215). Within the knowledge of producing such a picture is stored knowledge such as the color 
schenie, the composition of the screen (for example, gold divisions), and the like. Control 
information for producing the picture include finishing to make it lighter overall, finishing to 
slightly darken, painting touches, for example, to make the picture obtained close to the touches of 
van Gogh or Cezanne, or the like. 

[0216] 

In the multimedia art-producing device as shown in Figure 38, unage processing part (220) 
references knowledge base (215) where knowledge prepared in advance is stored and processes 
the media information according to control information and the referenced information. Thus, all 



55 



the control elements required for producing art using the medium need riot be controlled and art of 
the same level as when full spec information (all that is required) is given can be produced with 
little input information. For example with performance support, the performer hardly needs to 
consider the elements of jazz theory to perform a musical piece because of the pitch assignment 
means. Because of this, the amount of attention required to produce art in each medium and the 
amount of manipulation of the media information input part are decreased and cognitive overload 
is eliminated. So, the producer can have excess energy and art can be producesd using multiple 
media simultaneously. Because of the knowledge stored in knowledge base (215), the produced art 
is assured of exceeding a fixed standard, a minimum standard of quality can necessarily be 
achieved with the overall product, and a multimedia product in which variation in art quality 
between media is minimized. Therefore, even when concentrating on art production with one 
medium at that instant and neglecting art production with the other media, art of a certain standard 
will necessarily be produced, and the overall balance of the product will not be significantly upset. 
The knowledge stored in knowledge base (215) need only be sufficient knowledge to reduce the 
cognitive overload on the producer using the device, and a margin permitting manifestation of the 
creativity of the producer will remain without the production activities of the producer being 
excessively supported (a reference to the degree of freedom present in information selection in the 
performance support system). 

{0217] 

Information processing part (220) could also be constituted to reference the corresponding 
knowledge in knowledge base (215) for the media individually and to process die information for 
the corresponding medium. Also, information processing part (220) could also be constituted so 
that control information is replaced between the media for processing information to maintain 
harmony between media in the art. 

[0218] 

Effect of the invention 

An electronic kaleidoscopic image that generates a kaleidoscopic image signal according 
to an imaging signal from a musical instrument with a performance support function constituted by 
a musical instrument and a performance support system and a video camera can (be used] even by 
a novice to easily create a product above a standard level. Furthermore, a margin for the user to 
make embellishments in its use also remains. Therefore, it is also possible to pursue higher level 
production. Therefore, even a novice can simultaneously generate music and video above a 
standard level by following the present invention that uses these, and creation of products in which 
both [music and video] are sufficiently harmonious can easily be realized. 
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[0219] 

Also, in the multimedia art-producing device, media information for producing art and 
control information indicating the conditions for the art are used for each individual medium, 
knowledge corresponding to each medium that is prepared in advance is referenced, input media 
information is processed based on control information and the referenced knowledge, and 
information is presented according to the processed information using the corresponding medixmi. 
Thus, it is quite possible to generate a multimedia art product in which the art produced by any of 
the media will have a fixed standard, and overall, will necessarily have a fixed quality standard, 
and in which there is little variation in quality within the art. 

Brief description of the figures 

Figure 1 is a figure schematically showing the overall constitution of a realtime multimedia 
art-producing device according to the present invention. 

Figure 2 is a flow chart showing a synopsis of operation by the kaleidoscopic 
image-generating device shown in Figure 1. 

Figure 3 is a conceptual diagram for explaining operation of the kaleidoscopic 
image-generating device corresponding to when 2 mirrors are present. 

Figure 4 is a conceptual diagram for explaining operation of the kaleidoscopic 
image-generating device corresponding to when 3 mirrors are present 

Figure S is a conceptual diagram showing the generation process for reflection patterns that 
do not intersect mirror boundaries. 

Figure 6 is a conceptual diagram showing the generation process for patterns that intersect 
mirror boimdaries. 

Figure 7 is a conceptual diagram showing the generation process for a kaleidoscopic image 
when 4 mirrors are present. 

Figure 8 is a flow chart for explaining operation of a variant example of the kaleidoscopic 
image-generating device. 

Figure 9 is a conceptual diagram showing the generation process for a kaleidoscopic image 
based on an initial image piece in a normal triangular shape. 

Figure 10 is a conceptual diagram showing the kaleidoscopic image generation process 
with an optical process for the kaleidoscopic image shown in Figure 9, 

Figure 1 1 is a first conceptual diagram explaining the operation of the kaleidoscopic 
image-generating device for generating the kaleidoscopic image shown in Figure 9. 

Figure 12 is a conceptual diagram showing priority sequencing for reflection pattem 
generation. 
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Figure 13 is a tree diagram showing an algorithm for reflection pattern generation, 

Figure 14 is a second conceptual diagram explaining the operation of the kaleidoscopic 
image generation shown in Figure 9. 

Figure 15 is a schematic block diagram showing the constitution of a second variant 
example of a kaleidoscopic image-generating device. 

Figure 16 is a conceptual diagram showing operation of the kaleidoscopic 
image-generating device and computer graphics generating device shown in Figure 1 8. 

Figure 17 is a flow chart showing operation of the constitution show in Figure 18. 

Figure 18 is a figure schematically showing the constitution of a performance environment 
that includes the performance support system shown in Figxire 1. 

Figure 19 is a figure schematically showing the constitution of the performance support 
system shown in Figure 1 . 

Figure 20 is a figure schematically showing the constitution of the automatic analyzer 
shown in Figure 19. 

Figure 21 is a figure showing one example of usable scales for a chord analyzed by the 
automatic analyzer shown in Figure 20. 

Figure 22 is a figure schematically showing the constitution of the pitch assignment part 
shown in Figure 19. 

Figures 23 (A) and (B) are figures showing actual examples of scale tone series. 
Figure 24 is a figure showing processing by the position/pitch correlation part shown in 
Figure 22. 

Figure 25 is a figure schematically showing chord replacement by the automatic analyzer 
shown in Figure 20. 

Figure 26 is a fiow chart showing the chord replacement operation by the automatic 
analyzer shown in Figure 25. 

Figure 27 is a figure schematically showing tiie constitution of the interaction support part 
shown in Figure 19. 

Figure 28 is a figure showing one example of the configuration of the table stored in the 
position/scale table shown in Figure 27. 

Figure 29 is a figure schematically showing the constitution of a variant example of the 
interaction support part shown in Figure 27. 

Figure 30 is a figure schematically showing the constitution of the sensitivity tone series 
selection part of the interaction support part. 

Figure 3 1 is a figure showing one example of correspondences between the scales and 
sensitivity information stored in the sensitivity information database shown in Figure 30. 
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Figure 32 is a flow chart showing the operation of the sensitivity selection part shown in 
Figure 30. 

Figure 33 is a block diagram schematically showing another constitution for the interaction 
support part. 

Figure 34 is a diagram schematically showing the constitution of a variant example of the 
performance input interface. 

Figure 35 is a figure showing a concrete example of a variant example of the performance 
input interface shown in Figure 34. 

Figure 36 is a figure schematically showing the constitution of Embodiment 3 of a 
multimedia art-producing device according to the present invention. 

Figure 37 is a figure schematically showing the constitution of the image embellishment 
device shown in Figure 36. 

Figure 38 is a figure schematically showing the overall constitution of a multimedia 
art-producing device according to Embodiment 4 of the present invention. 

Explanation of reference symbols 



(1) 


Performer 


(2) 


Musical instrument 


(4) 


Performance support system 


(6) 


Camera 


(8) 


Kaleidoscopic image-generating device 


(10) 


Display device 


(12) 


Kaleidoscopic image-generating device 


(14) 


Computer graphics generating device 


(101), 


(102) Keyboard 


(103) 


Workstation 


(104) 


Sequencer 


(105) 


Sound module 


(106) 


Amp/speaker 


(110) 


Composition database 


(120) 


Performance support system 


(122) 


Automatic analyzer 


(124) 


Pitch assignment part 



(124a) Analysis result storage part 

(124b) Performance position/pitch assignment part 

( 1 26) Interaction support part 



(126a) Scale/tension correspondence information storage part 

(122a) Chord progression analysis part 

(122b) Rule table 

(122c) Scale determination part 

(134a) Analysis result storage part . . 

(134b) Scale to be used selection part 

(134c) Position/pitch correlation part 

(134d) Pitch information generation part 

(132a) Chord change detection part 

( 1 32b) Chord replacement part 

(132c) Chord table 

( 1 40) Tension distinguishing part 

(141) Performance chord storage part 

( 1 42) Scale identification part 

( 1 43) Tension/scale table 

(144) Scale selection part 

(145) Usable scale storage part 

( 1 50) Pitch/position conversion part 

(151) Current root tone information storage part 

( 1 52) Note clash judgment part 

( 1 54) Usable scale identification part 
(156) Scale to be used determination part 

( 1 60) Sensitivity information input interface 

(161) Sensitivity information database 

(1 62) Sensitivity judgment part 

( 1 63) Current scale information storage part 

( 1 64) Candidate scale determination part ( 1 64) 

( 1 65) Usable scale storage part 

( 1 66) Scale to be used determination part 
(170) Scale change part 

( 1 73) Usable scale storage part 

( 1 75) Scale to be used determination part 

(179a)-(179g) Performance position correspondence region 

(180a), (180b) Magnetic sensor 

( 1 82) Position detection means 

( 1 84) Performance position identification part 



(1 85) Performance position information input interface 

(190) Performance position identification part 

(200) Image embellishment device 

(2 1 0) Information input part 

(210a) Media information input part 

(210b) Control information input part 

(2 1 5) Knowledge base 

(220) Information processing part 

(230) Information presentation part 
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Figure 2 



Key: S102 Mirror arrangement input 

SI 04 Mirror movement input 

S 1 06 Calculation of shape parameters for cutout image part 

S108 Generation of kaleidoscopic image (and sound) from image input 
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Key: 1 Input image 
2 Output image 
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Key: 1 Mirror boundary 

2 Boxmdary reflection pattern 



© 

Figure 7 
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Figure 8 



Key: S202 Image input with video camera 

S204 Image piece shape parameter input 

S206 Cut-out of initial image piece 

S208 Reproduction of image piece 

S2 1 0 Arrangement using rotation and inversion 

S212 Space full [?] 

S214 Display 
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Figure 14 




Figure 15 



Key: 1 Parameter input 

2 Data input 

12 Kaleidoscopic image-generating device 

14 Computer graphics generating device 
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Figure 16 



Key: 1 Input image 

2 Computer graphics image 

3 Synthesis 

4 Kaleidoscopic image generation 



S302 



I 



3ytf*-^^^97^y^X —5308 



A* 



I 



.S304 

S306 



S810 



— S812 



— S314 



I 



— S316 




Figure 17 



S3 02 Image input by camera 

S304 Image piece shape parameter input 

S306 Cutting out of initial image piece 

S308 Computer graphics generation 

S3 1 0 Cutting out of initial image piece 

S3 12 Image synthesis 

S3 1 4 Reproduction of image piece 

S3 1 6 Arrangement using rotation and inversion 

S3 18 Space foil [?] 

S320 Display 
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Figure 18 




Figure 19 

Key: MOl Original pitch from keyboard 
M02a Pitch from keyboard (102) 
M03 Pitch after conversion 

1 Candidate scale 

2 Used scale 

3 Scale selection instruction 
110 Composition database 
122 Automatic analyzer 

1 24a Analysis result storage table 

1 26a Scale/tension correspondence information 
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Figure 20 



Key: 1 Chord information 

2 Scale information 

122a Chord progression analysis 

122b Rule table 

122c Scale determination part 
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Key: 1 Note information from keyboard (101) 

2 Pitch information 

134a Result analysis storage part 

1 34b Scale to be used selection part 

1 34c Position/pitch correlation part 

1 34d Pitch information generation part 
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Key: Ka Root tone 
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Kb Second [tone] 

Kc Third 

Kd Fourth 
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Figure 25 

Key: 1 Progression analysis with chord after replacement 

2 Chord information 

;i32a Chord conversion detection part 

1 32b Chord replacement part 

132c Chord table 

134c Chord information 
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Key: A Start 

B End 

550 1 Distance from adjacent chord root tone measua*ed 

5502 Measured distance and code for previous chord the same? 

5503 Select subject code 

5504 Both distances greater than threshold value? 

5505 Search chord table using subject chord and code as reference data 
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5506 Detect chord that will give smallest distance for chords on both sides from 
candidate chords 

5507 Chord information output 

5508 All chords completed? 
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Figure 27 

Key: 1 Backup pitch information (from keyboard (102)) 

2 From analysis result storage part 

3 Information for scale to be used (to pitch assignment part) 

4 Corresponds to scale to be used selection part (refer to Figure 22) 

140 Tension judgment part 

1 4 1 Performance chord storage part 

142 Scale identification part 

143 Tension/scale table 

144 Scale selection part 
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Figure 29 



Key: 1 Performance position information (from keyboard (101)) 

2 Backup pitch information (from keyboard) 

3 Information for scale to be used (to pitch assignment part) 
143 Tension/scale table 

145 Usable scale storage p^ 

150 Pitch/position conversion part 

151 Current root tone information storage part 

152 Note clash judgment part 

154 Usable scale identification part 

156 Scale to be used determination part 
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Key: 1 Usable scale information (to pitch assignment part) 

160 Sensitivity information input interface 

161 Sensitivity information database 

1 62 Sensitivity judgment part 

1 63 Current scale information storage part 

164 Candidate scale determination part 

165 Usable scale storage part 

1 66 Scale to be used determination part 
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Figure 32 

Key: S620 Sensitivity designated? 

562 1 Scale selected according to prescribed rules 

5622 Designated sensitivity judgment 

5623 Candidate scale determination 

5624 Is there scale corresponding to scale that can be designated? 

5625 Corresponding scale selected 

5626 Scale closest to candidate scale selected 

5627 Information for scale to be used given to pitch assignment part 
1 Start 
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Key: 1 Performance position information (from keyboard (101)) 

2 Backup pitch information (from keyboard (1 02)) 

3 Information for scale to be used (to pitch assignment part) 
143 Tension/scale table 

1 50 Pitch/position conversion part 

1 5 1 Current root tone information storage part 

1 52 Note clash judgment part 
154 Usable scale storage part 

160 Sensitivity information input interface 

1 6 1 Sensitivity information database 

162 Sensitivity judgment part 

163 Current scale information storage part 

164 Candidate scale determination part 
170 Scale update part 

173 Usable scale storage part 

175 Scale to be used determination part 
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Figure 35 

Key: 182 Position detection means 

1 84 Performance position identification part 
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Figure 36 

Key: 6 Video camera 

8 Kaleidoscopic image-generating device 
10 Display device 

1 90 Performance position identification part 
200 Image embellishment device 
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Figure 37 

Key 1 Performance position information 

8 Kaleidoscopic image-generating device 

1 Oa Image display controller 

10b Display screen 

200a Control part 

200b R processing part 

200c G processing part 

- 200d B processing part 
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